-- Logs begin at Sun 2022-07-31 17:56:22 UTC, end at Sun 2022-07-31 18:58:15 UTC. -- Jul 31 18:28:27.700068 dv-cinder-849846-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 31 18:28:27.709846 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 31 18:28:27.711800 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Jul 31 18:28:27 2022] *** Jul 31 18:28:27.711800 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 31 18:28:27.711800 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 31 18:28:27.711800 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: nodename: dv-cinder-849846-5-iscsi Jul 31 18:28:27.711800 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: machine: x86_64 Jul 31 18:28:27.711800 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: clock source: unix Jul 31 18:28:27.711800 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: pcre jit disabled Jul 31 18:28:27.711800 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: detected number of CPU cores: 4 Jul 31 18:28:27.711800 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: current working directory: / Jul 31 18:28:27.711800 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: detected binary path: /usr/bin/uwsgi-core Jul 31 18:28:27.711800 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: your processes number limit is 47680 Jul 31 18:28:27.711800 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: your memory page size is 4096 bytes Jul 31 18:28:27.711800 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: detected max file descriptor number: 2048 Jul 31 18:28:27.711800 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: lock engine: pthread robust mutexes Jul 31 18:28:27.712678 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: thunder lock: enabled Jul 31 18:28:27.712678 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 31 18:28:27.712678 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 31 18:28:27.750699 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: Python main interpreter initialized at 0x55aa452249c0 Jul 31 18:28:27.750699 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: python threads support enabled Jul 31 18:28:27.750699 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: your server socket listen backlog is limited to 100 connections Jul 31 18:28:27.750699 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: your mercy for graceful operations on workers is 90 seconds Jul 31 18:28:27.751053 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: mapped 403077 bytes (393 KB) for 2 cores Jul 31 18:28:27.751053 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: *** Operational MODE: preforking *** Jul 31 18:28:27.751348 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: *** uWSGI is running in multiple interpreter mode *** Jul 31 18:28:27.751348 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: spawned uWSGI master process (pid: 103401) Jul 31 18:28:27.751525 dv-cinder-849846-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 31 18:28:27.752592 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: spawned uWSGI worker 1 (pid: 103402, cores: 1) Jul 31 18:28:27.752592 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: spawned uWSGI worker 2 (pid: 103403, cores: 1) Jul 31 18:28:27.752592 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 31 18:28:28.399610 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 31 18:28:28.403158 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 31 18:28:29.466757 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 18:28:29.466757 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: from cryptography.utils import int_from_bytes Jul 31 18:28:29.467373 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 18:28:29.467373 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: from cryptography.utils import int_from_bytes Jul 31 18:28:29.467578 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 18:28:29.467578 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: from cryptography.utils import int_from_bytes Jul 31 18:28:29.468167 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 18:28:29.468167 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: from cryptography.utils import int_from_bytes Jul 31 18:28:31.957472 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 31 18:28:31.958175 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 31 18:28:31.958539 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 31 18:28:31.958638 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 31 18:28:31.958714 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 31 18:28:31.958786 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 31 18:28:31.958861 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 31 18:28:31.958934 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 31 18:28:31.959006 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 31 18:28:31.959107 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 31 18:28:31.959176 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.959357 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.959510 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.959654 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.959783 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.959987 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.960119 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.960283 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.960447 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.960596 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.960788 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.960914 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.961089 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.961250 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.961391 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.961592 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.961739 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.961920 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.962065 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.962153 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.962267 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.962484 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.962615 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-5-iscsi {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.962809 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-5-iscsi {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.962941 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.963119 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.963221 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.963425 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.963512 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.963737 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.963825 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.964056 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.964165 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.964359 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.964447 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.964681 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.964791 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.965012 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.965195 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.965513 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.965659 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.965830 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.965952 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.966171 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.966287 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.966460 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.966603 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.966772 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.966874 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.967088 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.967183 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.967499 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.967645 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.967794 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.967923 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.968116 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.968209 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.968418 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.968522 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.968734 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.968849 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-5-iscsi {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.969153 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.969261 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-5-iscsi {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.969466 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.969552 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.969777 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.969860 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.970108 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.970243 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.970482 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.970580 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.970796 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.970882 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.971107 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.971192 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.971427 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.971513 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.971737 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.971822 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.972042 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.972125 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.972369 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.972452 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.972685 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.972783 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.973031 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.973123 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.973351 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.973449 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.973656 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.973748 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.973965 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.974051 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.974276 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.974367 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.974592 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.974674 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.974893 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.974977 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.975142 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.975232 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.975436 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.975518 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.975745 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.975829 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.976066 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.976162 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.976385 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.976474 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.976642 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.976726 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.976918 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.977004 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.977207 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.977296 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.977528 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.977634 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.977849 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.977955 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.978154 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.978247 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.978461 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.978552 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.978766 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.978859 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.979071 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.979153 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.979381 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.979471 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.979687 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.979777 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.979993 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.980081 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.980298 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.980380 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.980616 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.980704 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.980963 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.981061 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.981274 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.981358 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.981587 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.981668 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.981899 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.981983 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.982218 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.982304 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.982527 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.982623 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.982835 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.982924 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.983200 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.983283 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.983510 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.983593 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.983817 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.983913 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.984136 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.984221 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.984442 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.984523 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.984749 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.984890 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.985081 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.985171 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.985389 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.985478 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.985712 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.985808 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.986017 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.986099 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.986269 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.986365 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.986571 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.986665 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.986873 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.986956 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.987178 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.987260 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.987482 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.987577 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.987787 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.987890 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.988091 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.988173 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.988388 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.988470 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.988685 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.988790 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.989014 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.989104 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.989322 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.989406 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.989627 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.989716 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.989930 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.990012 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.990232 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.990315 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.990535 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.990628 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.990839 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.990929 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.991141 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.991231 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.991445 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.991528 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.991764 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.991855 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.992067 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.992149 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.992374 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.992456 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.992676 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.992817 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.993007 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.993099 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.993311 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.993404 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.993624 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.993713 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.993930 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.994012 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.994237 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.994333 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.994540 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.994622 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.994848 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.994931 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.995155 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.995237 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.995464 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.995558 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.995768 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.995863 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.996077 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.996179 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.996376 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.996471 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.996684 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.996786 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.997016 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.997110 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.997322 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.997411 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.997628 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.997711 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.997930 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.998013 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.998232 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.998327 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.998533 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.998616 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.998889 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.998971 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.999194 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.999276 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.999497 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.999596 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.999799 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:31.999881 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:32.000097 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:32.000180 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:32.000417 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:32.000502 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:32.000730 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:32.000839 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:32.001063 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:32.001147 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:32.001368 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:32.001450 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:32.001671 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:32.001753 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:32.001990 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:28:32.002074 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.002325 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.002408 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.002657 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.002748 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.002972 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.003054 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.003302 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.003382 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.003637 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.003726 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.003959 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.004042 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.004278 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.004365 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.004592 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.004682 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.004935 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.005378 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.005607 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.005701 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.005923 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.006007 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.006237 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.006321 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.006550 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.006639 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.006871 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.006956 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.007192 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.007285 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.007511 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.007594 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.007826 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.007915 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.008144 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.008234 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.008458 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.008548 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.008802 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.008889 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.009126 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.009228 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.009439 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.009521 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.009755 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.009839 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.010064 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.010155 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.010408 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.010491 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.010732 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.010823 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.011051 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.011133 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.011371 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.011462 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.011686 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.011770 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.011996 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.012077 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.012307 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.012405 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.012616 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.012698 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.012966 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.013051 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.013280 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.013374 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.013603 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.013687 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.013919 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.014003 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.014255 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.014346 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.014569 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.014651 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.014880 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.014970 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.015189 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.015281 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.015499 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.015598 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.015826 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.015915 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.016140 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.016223 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.016450 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.016540 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.016781 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.016867 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.017097 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.017180 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.017408 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.017491 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.017719 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.017809 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.018027 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.018116 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.018332 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.018417 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.018634 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.018720 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.018936 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.019019 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.019239 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.019321 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.019545 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.019641 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.019865 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.019957 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.020169 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.020252 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.020486 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.020577 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.020818 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.020904 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.021139 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.021222 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.021449 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.021543 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.021757 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.021840 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.022065 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.022157 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.022370 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.022461 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.022680 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.022770 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.022987 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.023070 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.023297 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.023389 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.023613 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.023696 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.023923 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.024014 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.024225 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.024308 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.024542 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.024624 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.024872 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.024958 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.025181 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.025278 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.025489 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.025572 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.025798 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.025881 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.026108 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.026191 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.026417 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.026499 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.026734 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.026826 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.027050 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.027132 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.027360 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.027444 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.027673 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.027770 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.028010 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.028101 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.028316 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.028398 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.028639 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.028729 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.028989 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.029088 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.029310 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.029402 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.029616 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.029714 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.029986 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.030071 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.030299 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.030383 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.030604 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.030696 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.030910 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.030998 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.031214 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.031297 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.031517 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.031601 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.031820 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.031910 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.032123 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.032213 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.032424 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.032509 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.032728 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.032838 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.033059 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.033152 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.033379 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.033471 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.033686 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.033770 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.033990 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.034084 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.034297 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.034381 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.034596 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.034679 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.034932 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.035023 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.035234 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.035318 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.035581 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.035666 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.035898 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.035994 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.036221 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.036310 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.036538 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.036621 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.036872 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.036971 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.037184 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.037268 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.037492 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.037582 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.037802 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.037885 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.038111 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.038193 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.038424 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.038509 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.038734 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.038824 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.039042 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.039124 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.039351 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.039434 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.039665 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.039749 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.039975 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.040059 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.040286 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.040370 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.040592 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.040676 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.040923 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.041010 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.041239 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.041323 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.041578 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.041663 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.041893 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.041986 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.042218 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.042316 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.042532 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.042617 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.042848 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.042932 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.043160 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.043252 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.043473 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.043567 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.043785 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.043869 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.044099 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.044199 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.044413 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.044496 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.044723 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.044824 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.045061 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.045155 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.045371 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.045455 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.045750 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.045836 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.046063 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.046156 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.046371 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.046454 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.046683 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.046773 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.046985 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.047068 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.047303 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.047470 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.047616 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.047752 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.047937 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.048036 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.048243 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.048333 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.048560 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.048645 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.048902 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.048990 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.049218 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.049302 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.049529 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.049613 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.049837 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.049933 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.050142 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.050224 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.050445 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.050552 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.050755 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.050841 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.051065 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.051147 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.051371 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.051462 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.051675 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.051758 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.051978 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.052065 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.052291 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.052383 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.052597 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.052693 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.052923 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.053008 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.053232 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.053328 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.053543 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.053627 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.053853 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.053935 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.054162 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.054246 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.054483 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.054567 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.054788 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.054870 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.055095 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.055227 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.055398 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.055483 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.055711 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.055802 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.056017 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.056101 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.056321 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.056413 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.056621 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.056704 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.056948 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.057033 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.057286 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.057369 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.057593 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.057688 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.057896 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.057979 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.058215 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.058408 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.058522 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.058649 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.058836 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.058920 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.059146 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.059239 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.059457 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.059549 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.059774 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.059870 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.060085 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.060167 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.060396 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.060494 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.060705 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.060817 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.061058 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.061176 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.061381 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.061538 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.061689 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.061823 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.061994 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.062143 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.062301 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.062436 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.062605 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.062733 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.062912 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.062997 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.063215 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.063310 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.063636 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.063897 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.063897 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.064057 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.064210 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.066809 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.066809 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.067007 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.067076 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.067163 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.067241 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.067318 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.067394 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.067459 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.067523 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.067607 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.067675 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.067746 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.067823 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.067888 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.067952 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.068029 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.068106 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.068179 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.068252 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.068337 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.068404 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.068468 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.068531 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.068603 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.068673 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.068748 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.068872 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.068937 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.069110 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.069225 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.069376 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.069534 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.069774 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.069917 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.070083 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.070393 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.070524 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.070695 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.070988 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.071152 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.071322 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.071466 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.071611 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.071741 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.071871 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.072001 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.072148 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.072278 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.072446 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.072633 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.072836 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.073084 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.073190 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.073385 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.073592 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.073684 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.073914 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.073999 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.074227 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.074319 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.074538 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.074630 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.074850 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.074941 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.075195 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.075295 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.075562 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.075661 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.075869 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.076178 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.076263 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.076503 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.076886 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.076981 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.077207 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.077512 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.077596 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.077922 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.078014 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.078248 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.078543 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.078646 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.078866 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.078950 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.079192 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.079283 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.079502 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.079594 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.079813 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.079896 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.080126 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.080218 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.080434 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.080524 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.080743 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.080892 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.081075 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.081371 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.081482 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.081690 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.081890 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.081995 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.082298 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.082418 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.082609 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.082918 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.083002 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.083223 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.083425 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.083519 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.083824 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.083908 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.084142 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.084236 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.084448 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.084554 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.084755 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.084860 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.085081 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.085175 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.085394 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.085525 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.085704 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.085787 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.086010 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.086108 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.086321 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.086415 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.086630 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.086716 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.086933 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.087017 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.087239 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.087402 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.087544 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.087628 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.087851 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.087946 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.088155 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.088241 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.088466 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.088549 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.088804 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.088901 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.089119 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.089212 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.089423 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.089507 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.089729 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.089813 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.090033 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.090118 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.090338 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.090422 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.090642 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.090726 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.090947 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.091033 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.091253 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.091339 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.091562 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.091667 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.091864 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.091959 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.092170 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.092254 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.092501 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.092596 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.092830 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.092919 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.093144 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.093230 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.093447 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.093543 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.093752 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.093836 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.094056 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.094141 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.094356 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.094454 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.094664 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.094749 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.094973 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.095060 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.095282 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.095368 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.095607 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.095691 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.095925 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.096009 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.096243 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.096342 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.096534 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.096618 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.096860 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.096948 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.097166 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.097251 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.097483 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.097567 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.097795 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.097887 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.098107 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.098199 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.098415 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.098499 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.098718 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.098858 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.099039 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.099125 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.099349 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.099435 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.099658 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.099749 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.099964 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.100047 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.100281 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.100365 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.100594 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.100687 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.100924 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.101010 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.101234 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.101317 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.101539 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.101686 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.101845 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.101929 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.102155 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.102249 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.102465 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.102558 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.102775 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.102861 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.103087 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.103180 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.103400 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.103486 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.103703 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.103793 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.104009 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.104093 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.104318 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.104404 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.104625 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.104707 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.104958 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.105055 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.105265 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.105351 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.105576 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.105668 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.105888 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.105980 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.106194 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.106280 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.106503 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.106588 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.106809 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.106902 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.107116 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.107200 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.107421 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.107519 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.107728 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.107855 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.108090 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.108264 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.108423 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.108581 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.108737 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.108898 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.109067 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.109217 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.109370 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.109529 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.109679 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.109849 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.109996 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.110166 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.110302 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.110475 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.110738 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.110894 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.111053 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.111209 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.111367 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.111521 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.111674 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.111834 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.111988 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.112141 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.112302 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.112446 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.112618 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.112755 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.112958 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.113108 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.113268 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.113414 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.113686 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.113772 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.113999 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.114085 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.114314 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.114411 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.114617 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.114708 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.114922 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.115006 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.115225 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.115322 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.115537 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.115621 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.115867 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.115959 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.116176 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.116344 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.116483 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.116627 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.116812 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.116964 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.117138 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.117290 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.117444 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.117615 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.117766 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.117943 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.118183 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.118277 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.118495 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.118589 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.118802 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.118886 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.119169 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.119264 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.119495 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.119579 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.119808 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.119901 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.120123 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.120208 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.120431 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.120517 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.120772 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.120860 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.121087 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.121169 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.121401 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.121485 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.121712 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.121795 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.122041 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.122133 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.122368 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.122454 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.122681 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.122765 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.122997 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.123090 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.123305 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.123390 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.123655 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.123743 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.123987 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.124085 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.124287 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.124372 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.124593 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.124684 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.124926 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.125026 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.125251 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.125336 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.125559 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.125651 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.125872 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.125965 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.126185 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.126269 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.126495 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.126579 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.126801 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.126889 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.127107 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.127199 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.127430 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.127514 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.127736 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.127832 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.128056 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.128140 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.128360 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.128444 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.128685 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.128789 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.129024 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.129154 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.129334 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.129420 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.129642 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.129736 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.129947 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.130396 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.130616 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.130708 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.130922 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.131013 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.131227 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.131311 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.131545 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.131637 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.131863 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.131990 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.132185 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.132269 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.132494 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.132587 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.133952 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.134050 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.134118 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.134183 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.134248 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.134327 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.134395 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.134460 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.134523 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.134523 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.134650 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.134930 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.135032 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.135229 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.135316 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.135565 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.135660 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.135876 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.135961 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.136186 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.136286 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.136500 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.136594 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.136833 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.136931 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.137148 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.137234 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.137457 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.137589 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.137761 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.137846 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.138069 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.138154 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.138371 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.138463 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.138678 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.138763 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.138982 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.139065 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.139352 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.139446 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.139684 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.139778 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.139995 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.140078 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.140299 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.140385 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.140604 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.140689 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.140935 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.141035 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.141244 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.141328 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.141568 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.141661 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.141880 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.141972 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.142187 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.142279 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.142491 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.142576 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.142796 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.142890 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.143139 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.143232 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.143445 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.143560 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.143781 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.143876 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.144099 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.144184 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.144425 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.144509 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.144756 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.144858 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.145090 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.145175 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.145421 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.145506 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.145736 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.145828 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.146049 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.146177 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.146366 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.146451 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.146679 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.146771 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.146995 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.147079 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.147312 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.147548 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.147683 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.147885 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.147970 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.148205 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.148292 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.148524 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.148617 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.148864 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.148962 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.149183 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.149418 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.149511 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.149759 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.149851 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.150079 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.150164 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.150399 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.150492 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.150708 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.150792 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.151025 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.151108 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.151340 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.151432 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.151658 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.151744 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.151983 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.152093 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.152283 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.152380 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.152594 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.152678 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.152937 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.153035 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.153255 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.153340 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.153579 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.153663 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.153915 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.154007 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.154225 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.154310 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.154539 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.154622 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.154876 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.154976 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.155193 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.155277 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.155505 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.155592 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.155821 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.155907 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.156135 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.156271 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.156450 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.156534 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.156778 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.156880 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.157092 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.157178 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.157404 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.157487 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.157713 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.157797 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.158024 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.158109 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.158339 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.158441 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.158652 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.158746 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.158962 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.159047 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.159274 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.159366 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.159587 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.159678 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.159910 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.160109 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.160245 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.160424 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.160569 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.160806 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.160908 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.161117 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.161209 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.161444 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.161529 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.161762 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.162022 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.162107 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.162341 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.162426 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.162681 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.162765 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.162985 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.163068 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.163298 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.163387 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.163608 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.163693 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.163914 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.163999 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.164236 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.164322 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.164539 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.164621 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.164866 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.164965 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.165176 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.165260 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.165487 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.165577 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.165795 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.166020 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.166106 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.166371 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.166456 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.166685 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.166769 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.167008 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.167100 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.167319 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.167411 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.167635 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.167855 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.167948 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.168208 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.168292 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.168525 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.168617 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.168857 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.168945 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.169178 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.169273 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.169491 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.169584 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.169804 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.169890 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.170111 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.170203 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.170420 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.170552 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.170779 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.170864 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.171083 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.171167 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.171395 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.171480 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.171700 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.171783 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.172006 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.172091 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.172316 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.172411 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.172623 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.172707 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.172953 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.173040 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.173263 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.173356 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.173566 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.173649 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.173873 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.173958 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.174178 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.174270 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.174481 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.174573 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.174784 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.174874 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.175085 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.175177 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.175388 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.175478 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.175693 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.175777 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.175996 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.176080 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.176301 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.176392 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.176609 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.176700 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.176939 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.177027 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.177252 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.177336 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.177561 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.177652 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.177876 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.177961 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.178180 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.178262 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.178491 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.178581 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.178815 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.178901 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.179128 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.179213 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.179440 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.179532 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.179742 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.179825 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.180060 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.180145 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.180373 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.180606 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.180694 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.180971 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.181057 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.181297 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.181397 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.181632 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.181718 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.181959 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.182042 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.182267 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.182492 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.182586 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.182827 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.182911 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.183151 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.183243 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.183484 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.183576 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.183800 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.183885 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.184108 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.184191 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.184418 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.184504 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.184725 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.184844 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.185060 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.185145 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.185373 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.185458 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.185683 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.185775 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.185992 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.186167 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.186327 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.186414 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.186637 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.186730 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.186947 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.187044 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.187255 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.187346 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.187564 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.187647 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.187874 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.187968 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.188184 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.188277 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.188492 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.188584 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.188823 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.188924 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.189136 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.189221 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.189448 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.189533 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.189758 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.189850 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.190070 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.190198 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.190380 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.190467 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.190691 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.190784 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.191007 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.191090 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.191324 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.191409 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.191635 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.191720 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.191940 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.192025 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.192247 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.192343 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.192559 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.192645 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.192904 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.193003 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.193243 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.193338 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.193561 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.193654 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.193866 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.193951 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.194206 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.194299 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.194518 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.194613 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.194844 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.194930 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.195156 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.195249 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.195488 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.195572 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.195815 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.195898 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.196140 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.196224 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.196449 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.196550 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.196779 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.196880 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.197087 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.197174 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.197394 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.197487 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.197705 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.197798 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.198025 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.198110 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.198338 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.198423 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.198643 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.198737 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.198948 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.199038 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.199253 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.199337 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.199553 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.199646 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.199859 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.199947 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.200168 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.200300 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.200471 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.200567 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.200815 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.200906 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.201102 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.201186 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.201405 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.201490 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.201726 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.201812 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.202060 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.202145 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.202367 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.202453 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.202670 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.202754 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.202973 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.203057 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.203274 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.203366 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.203576 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.203659 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.203875 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.203958 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.204178 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.204274 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.204479 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.204562 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.204796 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.204895 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.205110 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.205204 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.205415 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.205500 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.205723 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.205821 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.206028 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.206113 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.206334 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.206418 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.206665 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.206796 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.206988 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.207073 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.207302 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.207385 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.207664 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.207764 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.207923 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.208014 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.208248 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.208340 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.208559 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.208644 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.208897 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.208998 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.209226 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.209372 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.209542 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.209694 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.209854 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.210009 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.210189 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.210323 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.210503 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.210652 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.210817 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.210985 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.211129 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.211295 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.211443 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.211622 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.211758 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.211940 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.212069 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.212263 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.212395 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.212581 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.212723 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.212929 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.213055 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.213263 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.213383 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.213580 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.213699 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.213894 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.214008 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.214209 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.214323 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.214523 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.214637 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.214838 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.215004 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.215156 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.215270 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.215472 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.215565 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.215785 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.215879 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.216466 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.216599 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.216705 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.216830 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.216952 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.217058 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.217159 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.217266 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.217399 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.217505 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.217733 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.217851 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.218051 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.218161 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.218381 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.218492 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.218695 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.218812 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.219006 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.219121 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.219337 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.219449 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.219663 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.219780 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.219979 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.220096 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.220287 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.220404 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.220534 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 31 18:28:32.220651 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.220975 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.221292 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.223548 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.223548 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:28:32.223548 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 31 18:28:32.381929 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO dbcounter [None req-10dbc350-6fff-49ed-94b2-a08e991e8085 None None] Registered counter for database nova_api Jul 31 18:28:32.382146 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO dbcounter [None req-2bec926b-1224-42ba-9dfd-8a5e0c3a51d7 None None] Registered counter for database nova_api Jul 31 18:28:32.402628 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG oslo_db.sqlalchemy.engines [None req-2bec926b-1224-42ba-9dfd-8a5e0c3a51d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103403) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 18:28:32.405730 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG oslo_db.sqlalchemy.engines [None req-10dbc350-6fff-49ed-94b2-a08e991e8085 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103402) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 18:28:32.409799 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG dbcounter [-] [103403] Writer thread running {{(pid=103403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 18:28:32.412451 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG dbcounter [-] [103402] Writer thread running {{(pid=103402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 18:28:32.466391 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.context [None req-2bec926b-1224-42ba-9dfd-8a5e0c3a51d7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ecbfed3-af85-4afe-b379-031f6ba6062f(cell1) {{(pid=103403) load_cells /opt/stack/nova/nova/context.py:464}} Jul 31 18:28:32.468785 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.context [None req-10dbc350-6fff-49ed-94b2-a08e991e8085 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ecbfed3-af85-4afe-b379-031f6ba6062f(cell1) {{(pid=103402) load_cells /opt/stack/nova/nova/context.py:464}} Jul 31 18:28:32.470387 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG oslo_concurrency.lockutils [None req-2bec926b-1224-42ba-9dfd-8a5e0c3a51d7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:28:32.471996 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG oslo_concurrency.lockutils [None req-2bec926b-1224-42ba-9dfd-8a5e0c3a51d7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:28:32.472755 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG oslo_concurrency.lockutils [None req-10dbc350-6fff-49ed-94b2-a08e991e8085 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:28:32.472887 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG oslo_concurrency.lockutils [None req-2bec926b-1224-42ba-9dfd-8a5e0c3a51d7 None None] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:28:32.474362 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG oslo_concurrency.lockutils [None req-10dbc350-6fff-49ed-94b2-a08e991e8085 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:28:32.474755 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG oslo_concurrency.lockutils [None req-2bec926b-1224-42ba-9dfd-8a5e0c3a51d7 None None] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:28:32.475172 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG oslo_concurrency.lockutils [None req-10dbc350-6fff-49ed-94b2-a08e991e8085 None None] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:28:32.476798 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO dbcounter [None req-2bec926b-1224-42ba-9dfd-8a5e0c3a51d7 None None] Registered counter for database nova_cell0 Jul 31 18:28:32.477185 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG oslo_concurrency.lockutils [None req-10dbc350-6fff-49ed-94b2-a08e991e8085 None None] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:28:32.479197 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO dbcounter [None req-10dbc350-6fff-49ed-94b2-a08e991e8085 None None] Registered counter for database nova_cell0 Jul 31 18:28:32.482382 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO dbcounter [None req-2bec926b-1224-42ba-9dfd-8a5e0c3a51d7 None None] Registered counter for database nova_cell1 Jul 31 18:28:32.485227 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO dbcounter [None req-10dbc350-6fff-49ed-94b2-a08e991e8085 None None] Registered counter for database nova_cell1 Jul 31 18:28:32.490886 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG oslo_db.sqlalchemy.engines [None req-2bec926b-1224-42ba-9dfd-8a5e0c3a51d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103403) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 18:28:32.492645 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG oslo_db.sqlalchemy.engines [None req-10dbc350-6fff-49ed-94b2-a08e991e8085 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103402) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 18:28:32.496531 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG oslo_db.sqlalchemy.engines [None req-10dbc350-6fff-49ed-94b2-a08e991e8085 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103402) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 18:28:32.497862 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG oslo_db.sqlalchemy.engines [None req-2bec926b-1224-42ba-9dfd-8a5e0c3a51d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103403) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 18:28:32.500895 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG dbcounter [-] [103403] Writer thread running {{(pid=103403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 18:28:32.505628 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG dbcounter [-] [103403] Writer thread running {{(pid=103403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 18:28:32.506033 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG dbcounter [-] [103402] Writer thread running {{(pid=103402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 18:28:32.644038 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG dbcounter [-] [103402] Writer thread running {{(pid=103402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 18:28:32.649128 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO dbcounter [None req-2bec926b-1224-42ba-9dfd-8a5e0c3a51d7 None None] Registered counter for database nova_cell0 Jul 31 18:28:32.653555 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO dbcounter [None req-10dbc350-6fff-49ed-94b2-a08e991e8085 None None] Registered counter for database nova_cell0 Jul 31 18:28:32.658699 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG oslo_db.sqlalchemy.engines [None req-2bec926b-1224-42ba-9dfd-8a5e0c3a51d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103403) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 18:28:32.662513 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG oslo_db.sqlalchemy.engines [None req-10dbc350-6fff-49ed-94b2-a08e991e8085 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103402) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 18:28:32.663777 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG dbcounter [-] [103403] Writer thread running {{(pid=103403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 18:28:32.667671 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG dbcounter [-] [103402] Writer thread running {{(pid=103402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 18:28:32.995839 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: WARNING keystonemiddleware.auth_token [None req-2bec926b-1224-42ba-9dfd-8a5e0c3a51d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 18:28:32.999520 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: WARNING keystonemiddleware.auth_token [None req-10dbc350-6fff-49ed-94b2-a08e991e8085 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 18:28:33.003288 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: WARNING keystonemiddleware.auth_token [None req-2bec926b-1224-42ba-9dfd-8a5e0c3a51d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 18:28:33.007151 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: WARNING keystonemiddleware.auth_token [None req-10dbc350-6fff-49ed-94b2-a08e991e8085 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 18:28:33.343534 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: WARNING keystonemiddleware.auth_token [None req-2bec926b-1224-42ba-9dfd-8a5e0c3a51d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 18:28:33.348634 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: WARNING keystonemiddleware.auth_token [None req-10dbc350-6fff-49ed-94b2-a08e991e8085 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 18:28:33.349439 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: WARNING keystonemiddleware.auth_token [None req-2bec926b-1224-42ba-9dfd-8a5e0c3a51d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 18:28:33.354712 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55aa452249c0 pid: 103403 (default app) Jul 31 18:28:33.355029 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: WARNING keystonemiddleware.auth_token [None req-10dbc350-6fff-49ed-94b2-a08e991e8085 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 18:28:33.356797 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-2bec926b-1224-42ba-9dfd-8a5e0c3a51d7 None None] Calling method '>' {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:28:33.358028 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-2bec926b-1224-42ba-9dfd-8a5e0c3a51d7 None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001757 Jul 31 18:28:33.358436 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Sun Jul 31 18:28:33 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:28:33.360285 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55aa452249c0 pid: 103402 (default app) Jul 31 18:29:48.856248 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-2bec926b-1224-42ba-9dfd-8a5e0c3a51d7 None None] Calling method '>' {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:29:48.857291 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-2bec926b-1224-42ba-9dfd-8a5e0c3a51d7 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jul 31 18:29:48.857685 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 930 bytes} [Sun Jul 31 18:29:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:29:48.869613 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG dbcounter [-] [103402] Writing DB stats nova_api:SELECT=3 {{(pid=103402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:48.870725 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG dbcounter [-] [103402] Writing DB stats nova_cell1:SELECT=3 {{(pid=103402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:48.871710 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG dbcounter [-] [103402] Writing DB stats nova_cell0:SELECT=3 {{(pid=103402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:48.872779 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG dbcounter [-] [103402] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:49.714831 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-9e18bf2d-e442-42b2-b681-06b5461c81e7 admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:29:49.748233 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-9e18bf2d-e442-42b2-b681-06b5461c81e7 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.883774 Jul 31 18:29:49.748783 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1291 bytes} [Sun Jul 31 18:29:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:29:51.925646 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-2bec926b-1224-42ba-9dfd-8a5e0c3a51d7 None None] Calling method '>' {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:29:51.926602 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-2bec926b-1224-42ba-9dfd-8a5e0c3a51d7 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jul 31 18:29:51.927013 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 3/4] 10.222.0.49 () {54 vars in 930 bytes} [Sun Jul 31 18:29:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:29:52.360995 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-b039ec26-6ea4-4b83-82ed-b08cf20140ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "c1", "ram": 256, "name": "cirros256"}} {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:29:52.381560 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 18:29:52.381560 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: warnings.warn(msg) Jul 31 18:29:52.411173 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-b039ec26-6ea4-4b83-82ed-b08cf20140ae admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.478154 Jul 31 18:29:52.411739 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 2/5] 10.222.0.49 () {64 vars in 1282 bytes} [Sun Jul 31 18:29:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 18:29:52.426896 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG dbcounter [-] [103403] Writing DB stats nova_api:SELECT=3 {{(pid=103403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:52.427902 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG dbcounter [-] [103403] Writing DB stats nova_cell0:SELECT=3 {{(pid=103403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:52.429888 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG dbcounter [-] [103403] Writing DB stats nova_cell1:SELECT=3 {{(pid=103403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:52.430719 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG dbcounter [-] [103403] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:29:52.638488 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-66b45ec1-b7d3-4d99-8c1c-46b89f4d571c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:29:52.642981 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 18:29:52.642981 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: warnings.warn(msg) Jul 31 18:29:52.705115 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-66b45ec1-b7d3-4d99-8c1c-46b89f4d571c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283669 Jul 31 18:29:52.705987 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 4/6] 10.222.0.49 () {64 vars in 1335 bytes} [Sun Jul 31 18:29:52 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:29:54.888274 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-b039ec26-6ea4-4b83-82ed-b08cf20140ae admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:29:54.889713 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-b039ec26-6ea4-4b83-82ed-b08cf20140ae admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001993 Jul 31 18:29:54.890381 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 3/7] 10.222.0.49 () {54 vars in 930 bytes} [Sun Jul 31 18:29:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:29:55.543204 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-c6cbdf3b-a0bd-4565-b18d-0cfeaab2b5ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "ram": 512, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1}} {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:29:55.561881 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 18:29:55.561881 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: warnings.warn(msg) Jul 31 18:29:55.584918 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-c6cbdf3b-a0bd-4565-b18d-0cfeaab2b5ad admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.688470 Jul 31 18:29:55.585838 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 5/8] 10.222.0.49 () {64 vars in 1282 bytes} [Sun Jul 31 18:29:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 18:29:55.601924 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-f48665b8-9e4f-4937-b46f-e22ac7b9fc1f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:29:55.605073 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 18:29:55.605073 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: warnings.warn(msg) Jul 31 18:29:55.641213 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-f48665b8-9e4f-4937-b46f-e22ac7b9fc1f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043025 Jul 31 18:29:55.642058 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 4/9] 10.222.0.49 () {64 vars in 1335 bytes} [Sun Jul 31 18:29:55 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:29:57.850032 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-c6cbdf3b-a0bd-4565-b18d-0cfeaab2b5ad admin admin] Calling method '>' {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:29:57.850966 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-c6cbdf3b-a0bd-4565-b18d-0cfeaab2b5ad admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 31 18:29:57.851373 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 930 bytes} [Sun Jul 31 18:29:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:29:58.261693 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-8f27b263-6389-4f89-b8d2-fee629a9473f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "rxtx_factor": 1.0, "swap": 0, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:29:58.281775 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-8f27b263-6389-4f89-b8d2-fee629a9473f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.424706 Jul 31 18:29:58.282255 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 5/11] 10.222.0.49 () {64 vars in 1282 bytes} [Sun Jul 31 18:29:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 18:29:58.294113 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-2d818639-5756-4715-ae51-ae35a382b702 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:29:58.319272 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-2d818639-5756-4715-ae51-ae35a382b702 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028923 Jul 31 18:29:58.319969 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 7/12] 10.222.0.49 () {64 vars in 1335 bytes} [Sun Jul 31 18:29:58 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:30:00.500023 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-8f27b263-6389-4f89-b8d2-fee629a9473f admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:00.501684 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-8f27b263-6389-4f89-b8d2-fee629a9473f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002174 Jul 31 18:30:00.506875 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 6/13] 10.222.0.49 () {54 vars in 930 bytes} [Sun Jul 31 18:30:00 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:30:00.975047 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-86b3b04e-71c4-4124-bae5-ceb1d15ed90e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds2G", "ram": 2048, "vcpus": 2, "disk": 10, "id": "d3", "rxtx_factor": 1.0}} {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:30:01.018907 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-86b3b04e-71c4-4124-bae5-ceb1d15ed90e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.510363 Jul 31 18:30:01.019610 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 8/14] 10.222.0.49 () {64 vars in 1282 bytes} [Sun Jul 31 18:30:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 18:30:01.036083 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-aef78c57-a20d-463a-86f8-8c8786af2cad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:30:01.075994 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-aef78c57-a20d-463a-86f8-8c8786af2cad admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047521 Jul 31 18:30:01.080152 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 7/15] 10.222.0.49 () {64 vars in 1335 bytes} [Sun Jul 31 18:30:01 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:30:03.297133 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-86b3b04e-71c4-4124-bae5-ceb1d15ed90e admin admin] Calling method '>' {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:03.298144 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-86b3b04e-71c4-4124-bae5-ceb1d15ed90e admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jul 31 18:30:03.298543 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 9/16] 10.222.0.49 () {54 vars in 930 bytes} [Sun Jul 31 18:30:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:30:03.712076 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-f9623f81-ce09-453d-91f1-6bb355ae95c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d4", "vcpus": 4, "disk": 20, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "swap": 0}} {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:30:03.733842 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-f9623f81-ce09-453d-91f1-6bb355ae95c5 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.429385 Jul 31 18:30:03.735183 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 8/17] 10.222.0.49 () {64 vars in 1282 bytes} [Sun Jul 31 18:30:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 18:30:03.746921 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-20c4dcf7-ecf5-4d86-8e02-0ccb49c4d4c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:30:03.772054 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-20c4dcf7-ecf5-4d86-8e02-0ccb49c4d4c8 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028866 Jul 31 18:30:03.773015 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 10/18] 10.222.0.49 () {64 vars in 1335 bytes} [Sun Jul 31 18:30:03 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:30:05.968345 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-f9623f81-ce09-453d-91f1-6bb355ae95c5 admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:05.969534 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-f9623f81-ce09-453d-91f1-6bb355ae95c5 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001795 Jul 31 18:30:05.969924 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 9/19] 10.222.0.49 () {54 vars in 930 bytes} [Sun Jul 31 18:30:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:30:06.446406 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-02ae194d-8314-47e2-850b-2c08528f5870 admin admin] Calling method '>' {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:06.473611 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-02ae194d-8314-47e2-850b-2c08528f5870 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.497111 Jul 31 18:30:06.474207 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 11/20] 10.222.0.49 () {60 vars in 1291 bytes} [Sun Jul 31 18:30:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:30:08.729110 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-f9623f81-ce09-453d-91f1-6bb355ae95c5 admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:08.730899 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-f9623f81-ce09-453d-91f1-6bb355ae95c5 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002530 Jul 31 18:30:08.731711 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 10/21] 10.222.0.49 () {54 vars in 930 bytes} [Sun Jul 31 18:30:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:30:09.199630 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-3006efa6-525a-4f09-9f9c-f3ad8506ebfa admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "swap": 0, "id": "1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "ram": 512}} {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:30:09.222110 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-3006efa6-525a-4f09-9f9c-f3ad8506ebfa admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.478893 Jul 31 18:30:09.222716 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 12/22] 10.222.0.49 () {64 vars in 1282 bytes} [Sun Jul 31 18:30:08 2022] POST /compute/v2.1/flavors => generated 402 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 18:30:09.236439 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-0c5756e7-f114-4fc0-8386-6de5393a53f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:30:09.263340 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-0c5756e7-f114-4fc0-8386-6de5393a53f6 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031082 Jul 31 18:30:09.263962 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 11/23] 10.222.0.49 () {64 vars in 1332 bytes} [Sun Jul 31 18:30:09 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:30:11.547606 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-3006efa6-525a-4f09-9f9c-f3ad8506ebfa admin admin] Calling method '>' {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:11.548617 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-3006efa6-525a-4f09-9f9c-f3ad8506ebfa admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jul 31 18:30:11.549129 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 930 bytes} [Sun Jul 31 18:30:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:30:12.000259 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-7a7f10f8-328c-4d3f-818d-f1e2ca481214 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "m1.small", "vcpus": 1, "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:30:12.021218 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-7a7f10f8-328c-4d3f-818d-f1e2ca481214 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.466051 Jul 31 18:30:12.021769 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 12/25] 10.222.0.49 () {64 vars in 1282 bytes} [Sun Jul 31 18:30:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 18:30:12.033884 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-5837ac18-5271-4d25-bee0-f05e60f7879b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:30:12.061268 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-5837ac18-5271-4d25-bee0-f05e60f7879b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031191 Jul 31 18:30:12.070228 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 14/26] 10.222.0.49 () {64 vars in 1332 bytes} [Sun Jul 31 18:30:12 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:30:14.222866 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-7a7f10f8-328c-4d3f-818d-f1e2ca481214 admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:14.223291 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-7a7f10f8-328c-4d3f-818d-f1e2ca481214 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jul 31 18:30:14.224306 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 930 bytes} [Sun Jul 31 18:30:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:30:14.627061 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-1bf1b9ce-8f49-4be5-8613-8b03c33b5d32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "name": "m1.medium", "disk": 40}} {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:30:14.648463 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-1bf1b9ce-8f49-4be5-8613-8b03c33b5d32 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.418426 Jul 31 18:30:14.656117 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 15/28] 10.222.0.49 () {64 vars in 1282 bytes} [Sun Jul 31 18:30:14 2022] POST /compute/v2.1/flavors => generated 406 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 18:30:14.661137 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-f41da7f3-4bc0-411e-a990-f03f894e2d6f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:30:14.689445 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-f41da7f3-4bc0-411e-a990-f03f894e2d6f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031765 Jul 31 18:30:14.690127 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 14/29] 10.222.0.49 () {64 vars in 1332 bytes} [Sun Jul 31 18:30:14 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:30:16.895753 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-1bf1b9ce-8f49-4be5-8613-8b03c33b5d32 admin admin] Calling method '>' {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:16.896781 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-1bf1b9ce-8f49-4be5-8613-8b03c33b5d32 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001645 Jul 31 18:30:16.897172 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 16/30] 10.222.0.49 () {54 vars in 930 bytes} [Sun Jul 31 18:30:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:30:17.337850 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-bf7b8311-0e62-42e0-9da0-12459b1ede7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 8192, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "disk": 80, "rxtx_factor": 1.0}} {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:30:17.359520 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-bf7b8311-0e62-42e0-9da0-12459b1ede7e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.456361 Jul 31 18:30:17.360396 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 15/31] 10.222.0.49 () {64 vars in 1282 bytes} [Sun Jul 31 18:30:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 18:30:17.372640 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-a41a74b2-ddb0-4e68-8d54-900bbda9c13e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:30:17.399945 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-a41a74b2-ddb0-4e68-8d54-900bbda9c13e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031185 Jul 31 18:30:17.400828 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 17/32] 10.222.0.49 () {64 vars in 1332 bytes} [Sun Jul 31 18:30:17 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:30:19.670752 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-bf7b8311-0e62-42e0-9da0-12459b1ede7e admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:19.671982 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-bf7b8311-0e62-42e0-9da0-12459b1ede7e admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001732 Jul 31 18:30:19.676103 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 16/33] 10.222.0.49 () {54 vars in 930 bytes} [Sun Jul 31 18:30:19 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:30:20.107387 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-6c4f6589-ffc0-4da0-a22c-07f395c2d2cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 160, "vcpus": 8, "ram": 16384, "name": "m1.xlarge"}} {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:30:20.127800 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-6c4f6589-ffc0-4da0-a22c-07f395c2d2cb admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.446537 Jul 31 18:30:20.128364 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 18/34] 10.222.0.49 () {64 vars in 1282 bytes} [Sun Jul 31 18:30:19 2022] POST /compute/v2.1/flavors => generated 408 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 18:30:20.140961 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-3c98afbe-d8da-4229-bad2-e9e6c291b011 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:30:20.149237 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG dbcounter [-] [103402] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:20.167915 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-3c98afbe-d8da-4229-bad2-e9e6c291b011 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030719 Jul 31 18:30:20.168500 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 17/35] 10.222.0.49 () {64 vars in 1332 bytes} [Sun Jul 31 18:30:20 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:30:39.712154 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-6c4f6589-ffc0-4da0-a22c-07f395c2d2cb admin admin] Calling method '>' {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:39.713339 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-6c4f6589-ffc0-4da0-a22c-07f395c2d2cb admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001701 Jul 31 18:30:39.713849 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 930 bytes} [Sun Jul 31 18:30:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:30:40.143988 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-01ebd1c7-2588-4737-8cb5-b4ffdea1fcac admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:40.166101 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-01ebd1c7-2588-4737-8cb5-b4ffdea1fcac admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.440445 Jul 31 18:30:40.166645 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1291 bytes} [Sun Jul 31 18:30:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:30:41.238837 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-6c4f6589-ffc0-4da0-a22c-07f395c2d2cb admin admin] Calling method '>' {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:41.239857 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-6c4f6589-ffc0-4da0-a22c-07f395c2d2cb admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 31 18:30:41.240250 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1074 bytes} [Sun Jul 31 18:30:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:30:41.926849 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-6e029da7-eb17-463e-9bf6-11b30d444f6d admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:41.932810 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.wsgi [None req-6e029da7-eb17-463e-9bf6-11b30d444f6d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 31 18:30:41.935973 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-6e029da7-eb17-463e-9bf6-11b30d444f6d admin admin] Request method failure captured: Jul 31 18:30:41.935973 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 31 18:30:41.935973 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: Accept: application/json Jul 31 18:30:41.935973 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: Accept-Encoding: gzip, deflate Jul 31 18:30:41.935973 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: Connection: keep-alive Jul 31 18:30:41.935973 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: Content-Length: 0 Jul 31 18:30:41.935973 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: Host: 10.222.0.49 Jul 31 18:30:41.935973 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: Openstack-Api-Version: compute 2.90 Jul 31 18:30:41.935973 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: Openstack-System-Scope: None Jul 31 18:30:41.935973 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: User-Agent: python-novaclient Jul 31 18:30:41.935973 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Auth-Token: gAAAAABi5spRX0I4Chs8c8pCdgfjJzCs8az-xuH5pmpsWG_PoGiaK7pHTZXfPzWjwrjJY34XCh3ddYMK2N59Eu89hTsqWJYjL6-aG4mIpd69W6Lv7pQeTbj5hhBx-MDgrEQdoeY4p0KVB0ebEpNFk42yKqhxRxGT5-waKtu0Fo-BnJH_mnupBgs Jul 31 18:30:41.935973 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Domain-Id: None Jul 31 18:30:41.935973 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Domain-Name: None Jul 31 18:30:41.935973 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Identity-Status: Confirmed Jul 31 18:30:41.935973 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Is-Admin-Project: True Jul 31 18:30:41.935973 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Openstack-Nova-Api-Version: 2.90 Jul 31 18:30:41.935973 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Project-Domain-Id: default Jul 31 18:30:41.935973 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Project-Domain-Name: Default Jul 31 18:30:41.935973 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Project-Id: 57e06c47f85e41698c0742550f1a32ec Jul 31 18:30:41.935973 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Project-Name: admin Jul 31 18:30:41.935973 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Role: reader,member,admin Jul 31 18:30:41.935973 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Roles: reader,member,admin Jul 31 18:30:41.937673 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57e06c47f85e41698c0742550f1a32ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_57e06c47f85e41698c0742550f1a32ec", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/57e06c47f85e41698c0742550f1a32ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57e06c47f85e41698c0742550f1a32ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:30:41.937673 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Tenant: admin Jul 31 18:30:41.937673 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Tenant-Id: 57e06c47f85e41698c0742550f1a32ec Jul 31 18:30:41.937673 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Tenant-Name: admin Jul 31 18:30:41.937673 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-User: admin Jul 31 18:30:41.937673 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-User-Domain-Id: default Jul 31 18:30:41.937673 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-User-Domain-Name: Default Jul 31 18:30:41.937673 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-User-Id: a62909c025a448a2a69b126becb412ba Jul 31 18:30:41.937673 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-User-Name: admin Jul 31 18:30:41.937673 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: method: > Jul 31 18:30:41.937673 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: exception: Flavor 42 could not be found. Jul 31 18:30:41.937673 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: action_args: {'id': '42'} Jul 31 18:30:41.937673 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:30:41.937673 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:30:41.938738 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 31 18:30:41.938738 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 31 18:30:41.938738 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 18:30:41.938738 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 18:30:41.938738 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 18:30:41.938738 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 18:30:41.938738 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 18:30:41.938738 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 18:30:41.938738 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 18:30:41.938738 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:30:41.938738 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 18:30:41.938738 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 18:30:41.938738 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 31 18:30:41.938738 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi Jul 31 18:30:41.938738 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:30:41.938738 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi Jul 31 18:30:41.938738 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:30:41.938738 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:30:41.938738 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:30:41.940192 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:30:41.940192 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:30:41.940192 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:30:41.940192 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:30:41.940192 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 31 18:30:41.940192 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:30:41.940192 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 31 18:30:41.940192 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi Jul 31 18:30:41.940192 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:30:41.940192 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi Jul 31 18:30:41.940192 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:30:41.940192 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:30:41.940192 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:30:41.940192 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:30:41.940192 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:30:41.940192 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 31 18:30:41.940192 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi Jul 31 18:30:41.940192 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-6e029da7-eb17-463e-9bf6-11b30d444f6d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:30:41.941563 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-6e029da7-eb17-463e-9bf6-11b30d444f6d admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.562486 Jul 31 18:30:41.941563 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 19/39] 10.222.0.49 () {60 vars in 1190 bytes} [Sun Jul 31 18:30:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 564 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 31 18:30:41.947410 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-6f23603c-d591-47dc-8038-73e23de1293e admin admin] Calling method '>' {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:41.951655 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG dbcounter [-] [103403] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:30:41.970712 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-6f23603c-d591-47dc-8038-73e23de1293e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026963 Jul 31 18:30:41.971286 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1210 bytes} [Sun Jul 31 18:30:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:30:41.981176 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-bf9ae899-606b-454a-9596-1ea68a98746d admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:42.005136 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-bf9ae899-606b-454a-9596-1ea68a98746d admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027128 Jul 31 18:30:42.005669 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1210 bytes} [Sun Jul 31 18:30:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 18:30:42.015580 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-8f4beeb7-0b42-46b0-beb7-c070fc0472e9 admin admin] Calling method '>' {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:42.022736 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.wsgi [None req-8f4beeb7-0b42-46b0-beb7-c070fc0472e9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 31 18:30:42.026022 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-8f4beeb7-0b42-46b0-beb7-c070fc0472e9 admin admin] Request method failure captured: Jul 31 18:30:42.026022 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 31 18:30:42.026022 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: Accept: application/json Jul 31 18:30:42.026022 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: Accept-Encoding: gzip, deflate Jul 31 18:30:42.026022 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: Connection: keep-alive Jul 31 18:30:42.026022 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: Content-Length: 0 Jul 31 18:30:42.026022 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: Host: 10.222.0.49 Jul 31 18:30:42.026022 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: Openstack-Api-Version: compute 2.90 Jul 31 18:30:42.026022 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: Openstack-System-Scope: None Jul 31 18:30:42.026022 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: User-Agent: python-novaclient Jul 31 18:30:42.026022 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Auth-Token: gAAAAABi5spRX0I4Chs8c8pCdgfjJzCs8az-xuH5pmpsWG_PoGiaK7pHTZXfPzWjwrjJY34XCh3ddYMK2N59Eu89hTsqWJYjL6-aG4mIpd69W6Lv7pQeTbj5hhBx-MDgrEQdoeY4p0KVB0ebEpNFk42yKqhxRxGT5-waKtu0Fo-BnJH_mnupBgs Jul 31 18:30:42.026022 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Domain-Id: None Jul 31 18:30:42.026022 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Domain-Name: None Jul 31 18:30:42.026022 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Identity-Status: Confirmed Jul 31 18:30:42.026022 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Is-Admin-Project: True Jul 31 18:30:42.026022 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Openstack-Nova-Api-Version: 2.90 Jul 31 18:30:42.026022 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Project-Domain-Id: default Jul 31 18:30:42.026022 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Project-Domain-Name: Default Jul 31 18:30:42.026022 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Project-Id: 57e06c47f85e41698c0742550f1a32ec Jul 31 18:30:42.026022 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Project-Name: admin Jul 31 18:30:42.026022 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Role: reader,member,admin Jul 31 18:30:42.026022 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Roles: reader,member,admin Jul 31 18:30:42.027376 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57e06c47f85e41698c0742550f1a32ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_57e06c47f85e41698c0742550f1a32ec", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/57e06c47f85e41698c0742550f1a32ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57e06c47f85e41698c0742550f1a32ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:30:42.027376 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Tenant: admin Jul 31 18:30:42.027376 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Tenant-Id: 57e06c47f85e41698c0742550f1a32ec Jul 31 18:30:42.027376 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Tenant-Name: admin Jul 31 18:30:42.027376 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-User: admin Jul 31 18:30:42.027376 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-User-Domain-Id: default Jul 31 18:30:42.027376 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-User-Domain-Name: Default Jul 31 18:30:42.027376 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-User-Id: a62909c025a448a2a69b126becb412ba Jul 31 18:30:42.027376 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-User-Name: admin Jul 31 18:30:42.027376 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: method: > Jul 31 18:30:42.027376 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: exception: Flavor 42 could not be found. Jul 31 18:30:42.027376 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: action_args: {'id': '42'} Jul 31 18:30:42.027376 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:30:42.027376 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:30:42.028165 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 31 18:30:42.028165 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 31 18:30:42.028165 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 18:30:42.028165 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 18:30:42.028165 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 18:30:42.028165 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 18:30:42.028165 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 18:30:42.028165 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 18:30:42.028165 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 18:30:42.028165 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:30:42.028165 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 18:30:42.028165 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 18:30:42.028165 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 31 18:30:42.028165 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi Jul 31 18:30:42.028165 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:30:42.028165 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi Jul 31 18:30:42.028165 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:30:42.028165 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:30:42.028165 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:30:42.029339 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:30:42.029339 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:30:42.029339 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:30:42.029339 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:30:42.029339 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 31 18:30:42.029339 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:30:42.029339 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 31 18:30:42.029339 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi Jul 31 18:30:42.029339 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:30:42.029339 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi Jul 31 18:30:42.029339 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:30:42.029339 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:30:42.029339 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:30:42.029339 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:30:42.029339 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:30:42.029339 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 31 18:30:42.029339 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi Jul 31 18:30:42.029339 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-8f4beeb7-0b42-46b0-beb7-c070fc0472e9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:30:42.030335 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-8f4beeb7-0b42-46b0-beb7-c070fc0472e9 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015882 Jul 31 18:30:42.030335 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 22/42] 10.222.0.49 () {60 vars in 1190 bytes} [Sun Jul 31 18:30:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 31 18:30:43.003517 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-bf9ae899-606b-454a-9596-1ea68a98746d admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:43.005566 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-bf9ae899-606b-454a-9596-1ea68a98746d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002692 Jul 31 18:30:43.006183 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 21/43] 10.222.0.49 () {56 vars in 1074 bytes} [Sun Jul 31 18:30:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:30:43.579449 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-a8fc43de-774e-4559-a86d-754bec5758d8 admin admin] Calling method '>' {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:43.585257 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.wsgi [None req-a8fc43de-774e-4559-a86d-754bec5758d8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 31 18:30:43.586759 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-a8fc43de-774e-4559-a86d-754bec5758d8 admin admin] Request method failure captured: Jul 31 18:30:43.586759 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 31 18:30:43.586759 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: Accept: application/json Jul 31 18:30:43.586759 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: Accept-Encoding: gzip, deflate Jul 31 18:30:43.586759 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: Connection: keep-alive Jul 31 18:30:43.586759 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: Content-Length: 0 Jul 31 18:30:43.586759 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: Host: 10.222.0.49 Jul 31 18:30:43.586759 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: Openstack-Api-Version: compute 2.90 Jul 31 18:30:43.586759 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: Openstack-System-Scope: None Jul 31 18:30:43.586759 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: User-Agent: python-novaclient Jul 31 18:30:43.586759 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Auth-Token: gAAAAABi5spSMLQ-sGBJtF8U4GBzA5boLRxyct7RiNXJcnO3VUn0B0PVnTZVH20GwIqz9z__vxa2QNvrRfISyq1GB8xNRfMs4EhzWw7fUGcKyYEGAthpHVEIqatSvpuLeJvCIAFKbdrI7Q462JVCrToMfcuGy22bLwepRdwHqUWNGBW1EdvXlro Jul 31 18:30:43.586759 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Domain-Id: None Jul 31 18:30:43.586759 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Domain-Name: None Jul 31 18:30:43.586759 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Identity-Status: Confirmed Jul 31 18:30:43.586759 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Is-Admin-Project: True Jul 31 18:30:43.586759 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Openstack-Nova-Api-Version: 2.90 Jul 31 18:30:43.586759 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Project-Domain-Id: default Jul 31 18:30:43.586759 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Project-Domain-Name: Default Jul 31 18:30:43.586759 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Project-Id: 57e06c47f85e41698c0742550f1a32ec Jul 31 18:30:43.586759 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Project-Name: admin Jul 31 18:30:43.586759 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Role: reader,member,admin Jul 31 18:30:43.586759 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Roles: reader,member,admin Jul 31 18:30:43.588243 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57e06c47f85e41698c0742550f1a32ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_57e06c47f85e41698c0742550f1a32ec", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/57e06c47f85e41698c0742550f1a32ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57e06c47f85e41698c0742550f1a32ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:30:43.588243 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Tenant: admin Jul 31 18:30:43.588243 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Tenant-Id: 57e06c47f85e41698c0742550f1a32ec Jul 31 18:30:43.588243 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Tenant-Name: admin Jul 31 18:30:43.588243 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-User: admin Jul 31 18:30:43.588243 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-User-Domain-Id: default Jul 31 18:30:43.588243 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-User-Domain-Name: Default Jul 31 18:30:43.588243 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-User-Id: a62909c025a448a2a69b126becb412ba Jul 31 18:30:43.588243 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-User-Name: admin Jul 31 18:30:43.588243 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: method: > Jul 31 18:30:43.588243 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: exception: Flavor 84 could not be found. Jul 31 18:30:43.588243 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: action_args: {'id': '84'} Jul 31 18:30:43.588243 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:30:43.588243 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:30:43.593238 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 31 18:30:43.593238 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 31 18:30:43.593238 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 18:30:43.593238 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 18:30:43.593238 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 18:30:43.593238 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 18:30:43.593238 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 18:30:43.593238 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 18:30:43.593238 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 18:30:43.593238 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:30:43.593238 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 18:30:43.593238 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 18:30:43.593238 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 31 18:30:43.593238 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi Jul 31 18:30:43.593238 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:30:43.593238 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi Jul 31 18:30:43.593238 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:30:43.593238 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:30:43.593238 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:30:43.594497 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:30:43.594497 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:30:43.594497 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:30:43.594497 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:30:43.594497 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 31 18:30:43.594497 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:30:43.594497 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 31 18:30:43.594497 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi Jul 31 18:30:43.594497 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:30:43.594497 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi Jul 31 18:30:43.594497 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:30:43.594497 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:30:43.594497 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:30:43.594497 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:30:43.594497 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:30:43.594497 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 31 18:30:43.594497 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi Jul 31 18:30:43.594497 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-a8fc43de-774e-4559-a86d-754bec5758d8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:30:43.595527 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-a8fc43de-774e-4559-a86d-754bec5758d8 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.436909 Jul 31 18:30:43.595527 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1190 bytes} [Sun Jul 31 18:30:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 438 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 31 18:30:43.598196 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-25509d2f-1d22-4bc1-9d11-cb9e4ca8f3c1 admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:43.613286 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-25509d2f-1d22-4bc1-9d11-cb9e4ca8f3c1 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018627 Jul 31 18:30:43.613835 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 22/45] 10.222.0.49 () {60 vars in 1210 bytes} [Sun Jul 31 18:30:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:30:43.623245 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-1ef57394-8e8b-4e90-ba11-361d72996bda admin admin] Calling method '>' {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:43.638750 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-1ef57394-8e8b-4e90-ba11-361d72996bda admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019014 Jul 31 18:30:43.639275 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1210 bytes} [Sun Jul 31 18:30:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 18:30:43.648441 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-a98a74d4-e523-4356-9de8-e186831c0222 admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:43.654164 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.wsgi [None req-a98a74d4-e523-4356-9de8-e186831c0222 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 31 18:30:43.655653 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-a98a74d4-e523-4356-9de8-e186831c0222 admin admin] Request method failure captured: Jul 31 18:30:43.655653 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 31 18:30:43.655653 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: Accept: application/json Jul 31 18:30:43.655653 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: Accept-Encoding: gzip, deflate Jul 31 18:30:43.655653 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: Connection: keep-alive Jul 31 18:30:43.655653 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: Content-Length: 0 Jul 31 18:30:43.655653 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: Host: 10.222.0.49 Jul 31 18:30:43.655653 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: Openstack-Api-Version: compute 2.90 Jul 31 18:30:43.655653 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: Openstack-System-Scope: None Jul 31 18:30:43.655653 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: User-Agent: python-novaclient Jul 31 18:30:43.655653 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Auth-Token: gAAAAABi5spSMLQ-sGBJtF8U4GBzA5boLRxyct7RiNXJcnO3VUn0B0PVnTZVH20GwIqz9z__vxa2QNvrRfISyq1GB8xNRfMs4EhzWw7fUGcKyYEGAthpHVEIqatSvpuLeJvCIAFKbdrI7Q462JVCrToMfcuGy22bLwepRdwHqUWNGBW1EdvXlro Jul 31 18:30:43.655653 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Domain-Id: None Jul 31 18:30:43.655653 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Domain-Name: None Jul 31 18:30:43.655653 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Identity-Status: Confirmed Jul 31 18:30:43.655653 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Is-Admin-Project: True Jul 31 18:30:43.655653 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Openstack-Nova-Api-Version: 2.90 Jul 31 18:30:43.655653 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Project-Domain-Id: default Jul 31 18:30:43.655653 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Project-Domain-Name: Default Jul 31 18:30:43.655653 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Project-Id: 57e06c47f85e41698c0742550f1a32ec Jul 31 18:30:43.655653 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Project-Name: admin Jul 31 18:30:43.655653 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Role: reader,member,admin Jul 31 18:30:43.655653 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Roles: reader,member,admin Jul 31 18:30:43.657180 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57e06c47f85e41698c0742550f1a32ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_57e06c47f85e41698c0742550f1a32ec", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/57e06c47f85e41698c0742550f1a32ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57e06c47f85e41698c0742550f1a32ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:30:43.657180 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Tenant: admin Jul 31 18:30:43.657180 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Tenant-Id: 57e06c47f85e41698c0742550f1a32ec Jul 31 18:30:43.657180 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Tenant-Name: admin Jul 31 18:30:43.657180 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-User: admin Jul 31 18:30:43.657180 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-User-Domain-Id: default Jul 31 18:30:43.657180 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-User-Domain-Name: Default Jul 31 18:30:43.657180 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-User-Id: a62909c025a448a2a69b126becb412ba Jul 31 18:30:43.657180 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-User-Name: admin Jul 31 18:30:43.657180 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: method: > Jul 31 18:30:43.657180 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: exception: Flavor 84 could not be found. Jul 31 18:30:43.657180 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: action_args: {'id': '84'} Jul 31 18:30:43.657180 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:30:43.657180 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:30:43.658182 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 31 18:30:43.658182 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 31 18:30:43.658182 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 18:30:43.658182 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 18:30:43.658182 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 18:30:43.658182 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 18:30:43.658182 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 18:30:43.658182 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 18:30:43.658182 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 18:30:43.658182 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:30:43.658182 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 18:30:43.658182 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 18:30:43.658182 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 31 18:30:43.658182 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi Jul 31 18:30:43.658182 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:30:43.658182 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi Jul 31 18:30:43.658182 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:30:43.658182 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:30:43.658182 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:30:43.659588 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:30:43.659588 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:30:43.659588 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:30:43.659588 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:30:43.659588 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 31 18:30:43.659588 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:30:43.659588 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 31 18:30:43.659588 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi Jul 31 18:30:43.659588 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:30:43.659588 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi Jul 31 18:30:43.659588 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:30:43.659588 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:30:43.659588 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:30:43.659588 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:30:43.659588 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:30:43.659588 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 31 18:30:43.659588 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi Jul 31 18:30:43.659588 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-a98a74d4-e523-4356-9de8-e186831c0222 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:30:43.660825 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-a98a74d4-e523-4356-9de8-e186831c0222 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012167 Jul 31 18:30:43.660825 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 23/47] 10.222.0.49 () {60 vars in 1190 bytes} [Sun Jul 31 18:30:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 31 18:30:44.624305 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-1ef57394-8e8b-4e90-ba11-361d72996bda admin admin] Calling method '>' {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:44.625411 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-1ef57394-8e8b-4e90-ba11-361d72996bda admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Jul 31 18:30:44.625799 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 25/48] 10.222.0.49 () {56 vars in 1074 bytes} [Sun Jul 31 18:30:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:30:45.177609 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-9e7fb94c-ca1e-4b5f-b472-b23dc8f5503e admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:45.183466 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.wsgi [None req-9e7fb94c-ca1e-4b5f-b472-b23dc8f5503e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 31 18:30:45.185004 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-9e7fb94c-ca1e-4b5f-b472-b23dc8f5503e admin admin] Request method failure captured: Jul 31 18:30:45.185004 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 31 18:30:45.185004 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: Accept: application/json Jul 31 18:30:45.185004 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: Accept-Encoding: gzip, deflate Jul 31 18:30:45.185004 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: Connection: keep-alive Jul 31 18:30:45.185004 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: Content-Length: 0 Jul 31 18:30:45.185004 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: Host: 10.222.0.49 Jul 31 18:30:45.185004 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: Openstack-Api-Version: compute 2.90 Jul 31 18:30:45.185004 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: Openstack-System-Scope: None Jul 31 18:30:45.185004 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: User-Agent: python-novaclient Jul 31 18:30:45.185004 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Auth-Token: gAAAAABi5spUkZI0pTz10cS0lrJPeLm62p5WgTo_E8w-2Jm9Vy1dKRvnkjXP3_Zi2N8Y5sI7nFZgisozWKgynnt4_M9jkOmem_Tk1FUV3GRjB7tQA98j_6AWSWs4-qZJBjUy8742j3PA7-293IIEyo1iXarGv2RaDF_lFbvL9AosEKX0gKwRuqw Jul 31 18:30:45.185004 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Domain-Id: None Jul 31 18:30:45.185004 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Domain-Name: None Jul 31 18:30:45.185004 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Identity-Status: Confirmed Jul 31 18:30:45.185004 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Is-Admin-Project: True Jul 31 18:30:45.185004 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Openstack-Nova-Api-Version: 2.90 Jul 31 18:30:45.185004 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Project-Domain-Id: default Jul 31 18:30:45.185004 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Project-Domain-Name: Default Jul 31 18:30:45.185004 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Project-Id: 57e06c47f85e41698c0742550f1a32ec Jul 31 18:30:45.185004 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Project-Name: admin Jul 31 18:30:45.185004 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Role: reader,member,admin Jul 31 18:30:45.185004 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Roles: reader,member,admin Jul 31 18:30:45.186492 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57e06c47f85e41698c0742550f1a32ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_57e06c47f85e41698c0742550f1a32ec", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/57e06c47f85e41698c0742550f1a32ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57e06c47f85e41698c0742550f1a32ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:30:45.186492 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Tenant: admin Jul 31 18:30:45.186492 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Tenant-Id: 57e06c47f85e41698c0742550f1a32ec Jul 31 18:30:45.186492 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-Tenant-Name: admin Jul 31 18:30:45.186492 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-User: admin Jul 31 18:30:45.186492 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-User-Domain-Id: default Jul 31 18:30:45.186492 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-User-Domain-Name: Default Jul 31 18:30:45.186492 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-User-Id: a62909c025a448a2a69b126becb412ba Jul 31 18:30:45.186492 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: X-User-Name: admin Jul 31 18:30:45.186492 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: method: > Jul 31 18:30:45.186492 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: exception: Flavor 451 could not be found. Jul 31 18:30:45.186492 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: action_args: {'id': '451'} Jul 31 18:30:45.186492 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:30:45.186492 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:30:45.187610 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 31 18:30:45.187610 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 31 18:30:45.187610 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 18:30:45.187610 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 18:30:45.187610 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 18:30:45.187610 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 18:30:45.187610 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 18:30:45.187610 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 18:30:45.187610 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 18:30:45.187610 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:30:45.187610 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 18:30:45.187610 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 18:30:45.187610 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 31 18:30:45.187610 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi Jul 31 18:30:45.187610 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:30:45.187610 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi Jul 31 18:30:45.187610 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:30:45.187610 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:30:45.187610 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:30:45.191500 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:30:45.191500 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:30:45.191500 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:30:45.191500 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:30:45.191500 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 31 18:30:45.191500 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:30:45.191500 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 31 18:30:45.191500 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi Jul 31 18:30:45.191500 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:30:45.191500 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi Jul 31 18:30:45.191500 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:30:45.191500 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:30:45.191500 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:30:45.191500 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:30:45.191500 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:30:45.191500 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 31 18:30:45.191500 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: ERROR nova.api.openstack.wsgi Jul 31 18:30:45.191500 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-9e7fb94c-ca1e-4b5f-b472-b23dc8f5503e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:30:45.192875 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-9e7fb94c-ca1e-4b5f-b472-b23dc8f5503e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.424064 Jul 31 18:30:45.192875 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 24/49] 10.222.0.49 () {60 vars in 1193 bytes} [Sun Jul 31 18:30:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 425 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 31 18:30:45.196427 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-def1aeb0-82d8-417c-917e-85f7764837a1 admin admin] Calling method '>' {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:45.211516 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-def1aeb0-82d8-417c-917e-85f7764837a1 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018694 Jul 31 18:30:45.212029 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 26/50] 10.222.0.49 () {60 vars in 1210 bytes} [Sun Jul 31 18:30:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 18:30:45.221538 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-9fe8ccfb-bd13-43fe-82f8-d118edef55fd admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:45.237118 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-9fe8ccfb-bd13-43fe-82f8-d118edef55fd admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019245 Jul 31 18:30:45.237653 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 25/51] 10.222.0.49 () {60 vars in 1210 bytes} [Sun Jul 31 18:30:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:30:45.247285 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-0aded849-61e2-46d0-9414-8ce97935262c admin admin] Calling method '>' {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:45.253142 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.wsgi [None req-0aded849-61e2-46d0-9414-8ce97935262c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 31 18:30:45.254997 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-0aded849-61e2-46d0-9414-8ce97935262c admin admin] Request method failure captured: Jul 31 18:30:45.254997 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 31 18:30:45.254997 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: Accept: application/json Jul 31 18:30:45.254997 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: Accept-Encoding: gzip, deflate Jul 31 18:30:45.254997 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: Connection: keep-alive Jul 31 18:30:45.254997 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: Content-Length: 0 Jul 31 18:30:45.254997 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: Host: 10.222.0.49 Jul 31 18:30:45.254997 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: Openstack-Api-Version: compute 2.90 Jul 31 18:30:45.254997 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: Openstack-System-Scope: None Jul 31 18:30:45.254997 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: User-Agent: python-novaclient Jul 31 18:30:45.254997 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Auth-Token: gAAAAABi5spUkZI0pTz10cS0lrJPeLm62p5WgTo_E8w-2Jm9Vy1dKRvnkjXP3_Zi2N8Y5sI7nFZgisozWKgynnt4_M9jkOmem_Tk1FUV3GRjB7tQA98j_6AWSWs4-qZJBjUy8742j3PA7-293IIEyo1iXarGv2RaDF_lFbvL9AosEKX0gKwRuqw Jul 31 18:30:45.254997 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Domain-Id: None Jul 31 18:30:45.254997 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Domain-Name: None Jul 31 18:30:45.254997 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Identity-Status: Confirmed Jul 31 18:30:45.254997 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Is-Admin-Project: True Jul 31 18:30:45.254997 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Openstack-Nova-Api-Version: 2.90 Jul 31 18:30:45.254997 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Project-Domain-Id: default Jul 31 18:30:45.254997 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Project-Domain-Name: Default Jul 31 18:30:45.254997 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Project-Id: 57e06c47f85e41698c0742550f1a32ec Jul 31 18:30:45.254997 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Project-Name: admin Jul 31 18:30:45.254997 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Role: reader,member,admin Jul 31 18:30:45.254997 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Roles: reader,member,admin Jul 31 18:30:45.256684 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57e06c47f85e41698c0742550f1a32ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_57e06c47f85e41698c0742550f1a32ec", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/57e06c47f85e41698c0742550f1a32ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57e06c47f85e41698c0742550f1a32ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:30:45.256684 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Tenant: admin Jul 31 18:30:45.256684 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Tenant-Id: 57e06c47f85e41698c0742550f1a32ec Jul 31 18:30:45.256684 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-Tenant-Name: admin Jul 31 18:30:45.256684 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-User: admin Jul 31 18:30:45.256684 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-User-Domain-Id: default Jul 31 18:30:45.256684 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-User-Domain-Name: Default Jul 31 18:30:45.256684 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-User-Id: a62909c025a448a2a69b126becb412ba Jul 31 18:30:45.256684 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: X-User-Name: admin Jul 31 18:30:45.256684 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: method: > Jul 31 18:30:45.256684 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: exception: Flavor 451 could not be found. Jul 31 18:30:45.256684 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: action_args: {'id': '451'} Jul 31 18:30:45.256684 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:30:45.256684 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:30:45.257913 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 31 18:30:45.257913 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 31 18:30:45.257913 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 18:30:45.257913 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 18:30:45.257913 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 18:30:45.257913 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 18:30:45.257913 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 18:30:45.257913 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 18:30:45.257913 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 18:30:45.257913 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:30:45.257913 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 18:30:45.257913 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 18:30:45.257913 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 31 18:30:45.257913 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi Jul 31 18:30:45.257913 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:30:45.257913 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi Jul 31 18:30:45.257913 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:30:45.257913 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:30:45.257913 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:30:45.259100 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:30:45.259100 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:30:45.259100 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:30:45.259100 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:30:45.259100 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 31 18:30:45.259100 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:30:45.259100 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 31 18:30:45.259100 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi Jul 31 18:30:45.259100 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:30:45.259100 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi Jul 31 18:30:45.259100 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:30:45.259100 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:30:45.259100 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:30:45.259100 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:30:45.259100 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:30:45.259100 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 31 18:30:45.259100 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: ERROR nova.api.openstack.wsgi Jul 31 18:30:45.259100 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-0aded849-61e2-46d0-9414-8ce97935262c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:30:45.260110 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-0aded849-61e2-46d0-9414-8ce97935262c admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012698 Jul 31 18:30:45.260110 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 27/52] 10.222.0.49 () {60 vars in 1193 bytes} [Sun Jul 31 18:30:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 31 18:30:46.217919 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-9fe8ccfb-bd13-43fe-82f8-d118edef55fd admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:46.218934 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-9fe8ccfb-bd13-43fe-82f8-d118edef55fd admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 31 18:30:46.219339 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1074 bytes} [Sun Jul 31 18:30:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:30:46.790906 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-5ade409c-d924-44bd-a7b7-9e3ad9d56d64 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:30:46.817206 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-5ade409c-d924-44bd-a7b7-9e3ad9d56d64 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.462277 Jul 31 18:30:46.817772 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 28/54] 10.222.0.49 () {64 vars in 1235 bytes} [Sun Jul 31 18:30:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 18:30:47.827408 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-9fe8ccfb-bd13-43fe-82f8-d118edef55fd admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:47.828501 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-9fe8ccfb-bd13-43fe-82f8-d118edef55fd admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 31 18:30:47.828967 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1074 bytes} [Sun Jul 31 18:30:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:30:48.387842 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-65dc5965-0813-4572-a3f7-8a27bc49687b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:30:48.409386 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-65dc5965-0813-4572-a3f7-8a27bc49687b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.440247 Jul 31 18:30:48.410100 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 29/56] 10.222.0.49 () {64 vars in 1235 bytes} [Sun Jul 31 18:30:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 18:30:49.406723 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-9fe8ccfb-bd13-43fe-82f8-d118edef55fd admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:49.407813 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-9fe8ccfb-bd13-43fe-82f8-d118edef55fd admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jul 31 18:30:49.408196 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 28/57] 10.222.0.49 () {56 vars in 1074 bytes} [Sun Jul 31 18:30:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:30:49.969709 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-bb1a6538-ac96-4f55-a3cc-6b811bcce3cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:30:49.990280 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-bb1a6538-ac96-4f55-a3cc-6b811bcce3cd admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.447048 Jul 31 18:30:49.990822 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 30/58] 10.222.0.49 () {64 vars in 1235 bytes} [Sun Jul 31 18:30:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 18:30:50.967396 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-9fe8ccfb-bd13-43fe-82f8-d118edef55fd admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:50.968396 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-9fe8ccfb-bd13-43fe-82f8-d118edef55fd admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 31 18:30:50.968847 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 29/59] 10.222.0.49 () {56 vars in 1074 bytes} [Sun Jul 31 18:30:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:30:51.512663 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-b8d12eb5-7443-4ab0-8eeb-e5f0759b5967 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:30:51.537399 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-b8d12eb5-7443-4ab0-8eeb-e5f0759b5967 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.432200 Jul 31 18:30:51.538054 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 31/60] 10.222.0.49 () {64 vars in 1235 bytes} [Sun Jul 31 18:30:51 2022] POST /compute/v2.1/flavors => generated 409 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 18:30:52.519098 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-9fe8ccfb-bd13-43fe-82f8-d118edef55fd admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:52.520101 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-9fe8ccfb-bd13-43fe-82f8-d118edef55fd admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 31 18:30:52.520466 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 30/61] 10.222.0.49 () {56 vars in 1074 bytes} [Sun Jul 31 18:30:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:30:53.091261 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-41bbdabd-0538-4b3c-8920-c267ba99ad0d admin admin] Calling method '>' {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:30:53.111672 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-41bbdabd-0538-4b3c-8920-c267ba99ad0d admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.455084 Jul 31 18:30:53.112210 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 32/62] 10.222.0.49 () {60 vars in 1202 bytes} [Sun Jul 31 18:30:52 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:31:44.706777 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-9fe8ccfb-bd13-43fe-82f8-d118edef55fd admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:31:44.708045 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-9fe8ccfb-bd13-43fe-82f8-d118edef55fd admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001910 Jul 31 18:31:44.708518 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 31/63] 10.222.0.49 () {54 vars in 930 bytes} [Sun Jul 31 18:31:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:31:44.719424 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG dbcounter [-] [103403] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:45.136650 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-f1bb3cb7-e2ab-41f8-a40d-92631187afe6 admin admin] Calling method '>' {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:31:45.163461 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-f1bb3cb7-e2ab-41f8-a40d-92631187afe6 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.448728 Jul 31 18:31:45.163978 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 33/64] 10.222.0.49 () {60 vars in 1291 bytes} [Sun Jul 31 18:31:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:31:45.186801 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-992c8dea-22c7-4701-9de7-f3a22e7bd2ef admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:31:45.190294 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG dbcounter [-] [103402] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:31:45.196303 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-992c8dea-22c7-4701-9de7-f3a22e7bd2ef admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013235 Jul 31 18:31:45.196831 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 32/65] 10.222.0.49 () {60 vars in 1282 bytes} [Sun Jul 31 18:31:45 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:31:45.208341 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-dd6a1664-17b9-4338-a461-f0791e997ec9 admin admin] Calling method '>' {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:31:45.216567 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-dd6a1664-17b9-4338-a461-f0791e997ec9 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011667 Jul 31 18:31:45.217197 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 34/66] 10.222.0.49 () {60 vars in 1285 bytes} [Sun Jul 31 18:31:45 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:31:45.228919 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-cf9243df-01db-4cae-84a1-1ac28f88b2af admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:31:45.237301 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-cf9243df-01db-4cae-84a1-1ac28f88b2af admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012308 Jul 31 18:31:45.237839 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 33/67] 10.222.0.49 () {60 vars in 1285 bytes} [Sun Jul 31 18:31:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:31:45.249325 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-f51a6e91-aba4-4adf-a4bf-57ac034483b1 admin admin] Calling method '>' {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:31:45.257522 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-f51a6e91-aba4-4adf-a4bf-57ac034483b1 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011901 Jul 31 18:31:45.258027 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 35/68] 10.222.0.49 () {60 vars in 1282 bytes} [Sun Jul 31 18:31:45 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:35:10.722876 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-cf9243df-01db-4cae-84a1-1ac28f88b2af admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:35:10.723898 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-cf9243df-01db-4cae-84a1-1ac28f88b2af admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Jul 31 18:35:10.724264 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1074 bytes} [Sun Jul 31 18:35:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:35:10.864653 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG dbcounter [-] [103403] Writing DB stats nova_api:SELECT=6 {{(pid=103403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:35:11.039728 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-5fb612f1-3810-450e-a0d0-0dfe3cb9ef0a admin admin] Calling method '>' {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:35:11.042160 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 18:35:11.042160 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: warnings.warn(msg) Jul 31 18:35:11.043407 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG oslo_concurrency.lockutils [None req-5fb612f1-3810-450e-a0d0-0dfe3cb9ef0a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:35:11.043844 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG oslo_concurrency.lockutils [None req-5fb612f1-3810-450e-a0d0-0dfe3cb9ef0a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:35:11.044655 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG oslo_concurrency.lockutils [None req-5fb612f1-3810-450e-a0d0-0dfe3cb9ef0a admin admin] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:35:11.045104 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG oslo_concurrency.lockutils [None req-5fb612f1-3810-450e-a0d0-0dfe3cb9ef0a admin admin] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:35:11.079284 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-5fb612f1-3810-450e-a0d0-0dfe3cb9ef0a admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.217543 Jul 31 18:35:11.079839 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 36/70] 10.222.0.49 () {60 vars in 1193 bytes} [Sun Jul 31 18:35:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 18:35:11.920714 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-cf9243df-01db-4cae-84a1-1ac28f88b2af admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:35:11.921767 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-cf9243df-01db-4cae-84a1-1ac28f88b2af admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jul 31 18:35:11.922160 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 35/71] 10.222.0.49 () {56 vars in 1074 bytes} [Sun Jul 31 18:35:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:35:12.126070 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-cd949226-7e14-4fb9-9e8d-ec39f8979933 admin admin] Calling method '>' {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:35:12.130421 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 18:35:12.130421 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: warnings.warn(msg) Jul 31 18:35:12.131976 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG oslo_concurrency.lockutils [None req-cd949226-7e14-4fb9-9e8d-ec39f8979933 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:35:12.132564 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG oslo_concurrency.lockutils [None req-cd949226-7e14-4fb9-9e8d-ec39f8979933 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:35:12.133485 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG oslo_concurrency.lockutils [None req-cd949226-7e14-4fb9-9e8d-ec39f8979933 admin admin] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:35:12.134029 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG oslo_concurrency.lockutils [None req-cd949226-7e14-4fb9-9e8d-ec39f8979933 admin admin] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:35:12.157037 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-cd949226-7e14-4fb9-9e8d-ec39f8979933 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.096375 Jul 31 18:35:12.157558 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 37/72] 10.222.0.49 () {60 vars in 1193 bytes} [Sun Jul 31 18:35:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 18:35:23.401263 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-cf9243df-01db-4cae-84a1-1ac28f88b2af admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:35:23.402289 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-cf9243df-01db-4cae-84a1-1ac28f88b2af admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jul 31 18:35:23.402669 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 36/73] 10.222.0.49 () {56 vars in 1074 bytes} [Sun Jul 31 18:35:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:35:23.546510 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG dbcounter [-] [103403] Writing DB stats nova_cell0:SELECT=4 {{(pid=103403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:35:23.547148 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG dbcounter [-] [103403] Writing DB stats nova_cell1:SELECT=4 {{(pid=103403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:35:23.547919 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG dbcounter [-] [103403] Writing DB stats nova_api:SELECT=8 {{(pid=103403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:35:23.606963 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-d0ad39e9-b859-4d89-af11-9e542ed9f98b admin admin] Calling method '>' {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:35:23.610427 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 18:35:23.610427 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: warnings.warn(msg) Jul 31 18:35:23.612189 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG oslo_concurrency.lockutils [None req-d0ad39e9-b859-4d89-af11-9e542ed9f98b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:35:23.612803 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG oslo_concurrency.lockutils [None req-d0ad39e9-b859-4d89-af11-9e542ed9f98b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:35:23.613930 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG oslo_concurrency.lockutils [None req-d0ad39e9-b859-4d89-af11-9e542ed9f98b admin admin] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:35:23.614540 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG oslo_concurrency.lockutils [None req-d0ad39e9-b859-4d89-af11-9e542ed9f98b admin admin] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:35:23.648394 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-d0ad39e9-b859-4d89-af11-9e542ed9f98b admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.109342 Jul 31 18:35:23.648987 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 38/74] 10.222.0.49 () {60 vars in 1193 bytes} [Sun Jul 31 18:35:23 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:35:24.472525 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: DEBUG nova.api.openstack.wsgi [None req-cf9243df-01db-4cae-84a1-1ac28f88b2af admin admin] Calling method '>' {{(pid=103402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:35:24.473514 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: INFO nova.api.openstack.requestlog [None req-cf9243df-01db-4cae-84a1-1ac28f88b2af admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jul 31 18:35:24.473909 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: [pid: 103402|app: 0|req: 37/75] 10.222.0.49 () {56 vars in 1074 bytes} [Sun Jul 31 18:35:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:35:24.679110 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG nova.api.openstack.wsgi [None req-a5cd3aee-eeca-43a8-bf00-b65556bcb5d8 admin admin] Calling method '>' {{(pid=103403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:35:24.681573 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 18:35:24.681573 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: warnings.warn(msg) Jul 31 18:35:24.682738 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG oslo_concurrency.lockutils [None req-a5cd3aee-eeca-43a8-bf00-b65556bcb5d8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:35:24.683172 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG oslo_concurrency.lockutils [None req-a5cd3aee-eeca-43a8-bf00-b65556bcb5d8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:35:24.683939 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG oslo_concurrency.lockutils [None req-a5cd3aee-eeca-43a8-bf00-b65556bcb5d8 admin admin] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:35:24.684351 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: DEBUG oslo_concurrency.lockutils [None req-a5cd3aee-eeca-43a8-bf00-b65556bcb5d8 admin admin] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:35:24.705974 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: INFO nova.api.openstack.requestlog [None req-a5cd3aee-eeca-43a8-bf00-b65556bcb5d8 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.094944 Jul 31 18:35:24.706523 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: [pid: 103403|app: 0|req: 39/76] 10.222.0.49 () {60 vars in 1193 bytes} [Sun Jul 31 18:35:24 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:36:20.477086 dv-cinder-849846-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 31 18:36:20.477658 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: Sun Jul 31 18:36:20 2022 - graceful shutdown triggered... Jul 31 18:36:20.478091 dv-cinder-849846-5-iscsi devstack@n-api.service[103402]: Gracefully killing worker 1 (pid: 103402)... Jul 31 18:36:20.478451 dv-cinder-849846-5-iscsi devstack@n-api.service[103403]: Gracefully killing worker 2 (pid: 103403)... Jul 31 18:36:21.478891 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: worker 1 buried after 1 seconds Jul 31 18:36:21.479773 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: worker 2 buried after 1 seconds Jul 31 18:36:21.479773 dv-cinder-849846-5-iscsi devstack@n-api.service[103401]: goodbye to uWSGI. Jul 31 18:36:21.481672 dv-cinder-849846-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 31 18:36:21.482550 dv-cinder-849846-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 31 18:36:21.487084 dv-cinder-849846-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 31 18:36:21.502076 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 31 18:36:21.505130 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Jul 31 18:36:21 2022] *** Jul 31 18:36:21.505312 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 31 18:36:21.505493 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 31 18:36:21.505652 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: nodename: dv-cinder-849846-5-iscsi Jul 31 18:36:21.505652 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: machine: x86_64 Jul 31 18:36:21.505652 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: clock source: unix Jul 31 18:36:21.505652 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: pcre jit disabled Jul 31 18:36:21.505652 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: detected number of CPU cores: 4 Jul 31 18:36:21.505652 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: current working directory: / Jul 31 18:36:21.505652 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: detected binary path: /usr/bin/uwsgi-core Jul 31 18:36:21.505652 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: your processes number limit is 47680 Jul 31 18:36:21.505652 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: your memory page size is 4096 bytes Jul 31 18:36:21.505652 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: detected max file descriptor number: 2048 Jul 31 18:36:21.506306 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: lock engine: pthread robust mutexes Jul 31 18:36:21.506306 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: thunder lock: enabled Jul 31 18:36:21.506306 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 31 18:36:21.506306 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 31 18:36:21.545356 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: Python main interpreter initialized at 0x557fb69a79c0 Jul 31 18:36:21.545356 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: python threads support enabled Jul 31 18:36:21.545356 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: your server socket listen backlog is limited to 100 connections Jul 31 18:36:21.545356 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: your mercy for graceful operations on workers is 90 seconds Jul 31 18:36:21.545825 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: mapped 403077 bytes (393 KB) for 2 cores Jul 31 18:36:21.545825 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: *** Operational MODE: preforking *** Jul 31 18:36:21.546075 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: *** uWSGI is running in multiple interpreter mode *** Jul 31 18:36:21.546075 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: spawned uWSGI master process (pid: 124322) Jul 31 18:36:21.546309 dv-cinder-849846-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 31 18:36:21.548360 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: spawned uWSGI worker 1 (pid: 124333, cores: 1) Jul 31 18:36:21.548360 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: spawned uWSGI worker 2 (pid: 124334, cores: 1) Jul 31 18:36:21.548360 dv-cinder-849846-5-iscsi devstack@n-api.service[124322]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 31 18:36:22.199589 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 31 18:36:22.203017 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 31 18:36:23.333749 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 18:36:23.333749 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: from cryptography.utils import int_from_bytes Jul 31 18:36:23.334418 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 18:36:23.334418 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: from cryptography.utils import int_from_bytes Jul 31 18:36:23.335728 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 18:36:23.335728 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: from cryptography.utils import int_from_bytes Jul 31 18:36:23.336207 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 18:36:23.336207 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: from cryptography.utils import int_from_bytes Jul 31 18:36:25.686500 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 31 18:36:25.687105 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 31 18:36:25.687429 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 31 18:36:25.687700 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 31 18:36:25.687919 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 31 18:36:25.688339 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.688665 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.689013 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.689334 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.689666 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.689978 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.690276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.690394 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 31 18:36:25.690788 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.690878 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 31 18:36:25.690990 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.691227 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.691324 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 31 18:36:25.691468 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.691611 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 31 18:36:25.691777 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 31 18:36:25.691876 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-5-iscsi {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.692092 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.692196 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.692453 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.692618 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.692818 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.692979 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.693127 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.693267 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.693438 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.693594 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.693743 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.693894 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.694056 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.694199 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.694354 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.694554 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.696088 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.696088 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.696528 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.696745 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.697019 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.697222 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-5-iscsi {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.697435 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.697643 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.697849 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.698068 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.698277 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.698496 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.698704 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.698920 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.699140 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.699352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.699559 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.699769 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.699967 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.700176 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.700389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.700389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-5-iscsi {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.700805 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.701048 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.701227 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.701549 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.701724 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.701872 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.702051 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.702051 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.702369 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.702842 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.703107 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.703265 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.704188 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.704365 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.704519 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.704694 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.704887 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.705037 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.705186 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.705381 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.705539 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.705947 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-5-iscsi {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.706102 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.706250 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.706389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.706538 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.706687 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.706908 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.707052 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.707052 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.707341 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.707525 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.707680 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.707819 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.707964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.708103 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.709317 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.709482 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.709648 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.709846 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.710002 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.710150 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.710294 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.710433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.710580 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.710729 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.710868 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.711016 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.711166 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.711313 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.711512 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.711673 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.711824 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.711963 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.712124 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.712273 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.712431 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.712578 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.712729 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.712927 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.713079 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.713226 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.713393 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.713544 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.713691 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.713848 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.714452 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.714607 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.714757 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.714905 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.715052 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.715199 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.715346 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.715503 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.715661 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.716071 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.716231 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.716378 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.716619 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.716796 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.716962 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.717110 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.717250 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.717250 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.717528 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.717682 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.717843 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.717984 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.718121 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.718258 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.718409 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.718558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.718696 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.718834 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.718970 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.719114 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.719265 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.719410 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.719555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.719923 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.720072 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.720211 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.720363 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.720502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.720648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.720648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.720998 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.720998 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.721565 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.721710 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.721870 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.721870 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.722166 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.722429 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.722592 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.722732 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.722877 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.723022 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.723160 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.723312 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.723463 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.723608 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.723746 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.723889 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.724038 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.724567 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.724711 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.724885 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.725027 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.725173 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.725322 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.725475 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.725614 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.725759 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.725936 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.726269 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.726416 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.726580 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.726823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.726967 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.727105 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.727242 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.727398 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.727546 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.727686 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.727823 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.727968 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.727968 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.728240 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.728388 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.728544 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.728683 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.728888 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.729118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.729276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.729430 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.729577 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.729724 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.729869 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.730015 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.730159 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.730296 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.730443 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.730602 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.730750 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.730897 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.731035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.731195 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.731463 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.731659 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.731810 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.731950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.732093 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.732233 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.732453 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.732609 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.732750 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.732933 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.733081 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.733220 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.733364 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.733504 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.733647 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.733795 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.733945 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.734084 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.734615 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.734768 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.734918 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.735067 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.735323 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.735481 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.735630 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.735768 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.735916 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.736081 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.736223 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.736467 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.736610 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.736879 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.737054 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.737211 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.737358 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.737497 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.737634 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.737771 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.737917 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.738056 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.738205 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.738351 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.738490 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.738635 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.738782 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.738922 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.739073 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.739211 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.739358 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.739507 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.739654 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.739798 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.739937 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.740075 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.740212 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.740360 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.740360 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.740632 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.740798 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.740942 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.741092 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.741246 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.741395 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.741542 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.741681 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 18:36:25.741829 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.741975 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.742134 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.742134 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.742416 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.743981 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.744148 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.744300 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.744477 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.745016 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.745176 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.745319 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.745465 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.745617 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.745882 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.746038 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.746185 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.746324 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.746474 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.746629 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.746778 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.747797 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.747959 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.748109 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.748250 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.748250 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.748529 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.748697 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.749284 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.749526 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.749678 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.749939 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.750096 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.750245 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.750392 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.750531 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.750671 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.750807 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.750954 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.751101 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.751240 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.751378 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.751517 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.751664 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.751821 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.751959 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.752096 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.752244 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.752390 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.752544 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.752692 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.752851 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.753006 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.753152 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.753298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.753450 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.753607 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.753754 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.753892 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.754037 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.754540 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.754900 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.755197 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.755347 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.755539 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.755691 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.755848 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.755989 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.756127 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.756286 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.756431 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.756612 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.756807 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.756965 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.757122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.757359 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.757547 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.757695 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.757862 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.758097 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.758249 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.758396 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.758554 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.758730 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.758889 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.759029 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.759174 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.759320 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.759458 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.759596 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.759787 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.759937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.760085 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.760231 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.760377 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.760580 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.760722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.760888 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.761040 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.761178 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.761358 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.761516 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.761859 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.762008 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.762162 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.762314 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.762454 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.762680 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.762832 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.762979 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.763117 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.763256 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.763406 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.763558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.763704 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.763858 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.764003 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.764151 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.764298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.764437 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.764585 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.764732 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.765217 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.765395 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.765550 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.765696 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.765842 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.765980 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.766118 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.766258 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.766412 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.766551 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.766688 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.766837 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.766981 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.767129 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.767282 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.767518 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.767670 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.767825 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.767973 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.768141 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.768365 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.768519 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.768658 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.768886 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.769061 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.769215 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.769362 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.769510 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.769647 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.769793 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.769940 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.770093 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.770241 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.770388 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.770534 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.770674 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.770824 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.770976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.771126 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.771272 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.771418 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.771565 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.771711 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.771850 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.771987 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.772139 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.772288 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.772434 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.772588 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.772737 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.772910 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.773050 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.773187 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.773337 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.773490 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.773631 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.773771 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.773919 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.774058 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.774197 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.774343 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.774481 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.774629 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.774767 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.774915 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.775395 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.775542 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.775682 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.775820 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.775967 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.776116 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.776265 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.776413 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.776552 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.776692 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.776899 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.777065 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.777227 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.777373 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.777545 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.777774 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.777919 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.778065 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.778218 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.778385 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.778614 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.778765 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.778915 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.779079 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.779229 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.779229 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.779499 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.779638 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.779775 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.779922 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.780060 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.780198 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.780342 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.780488 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.780625 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.780805 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.780952 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.781150 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.781342 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.781487 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.781640 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.781792 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.781939 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.782089 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.782280 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.782421 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.782574 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.782715 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.782870 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.783011 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.783149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.783286 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.783432 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.783578 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.783724 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.783863 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.784001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.784139 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.784284 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.784423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.784561 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.784708 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.784909 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.785060 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.785537 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.785694 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.785834 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.785980 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.786120 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.786265 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.786423 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.786571 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.786716 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.786869 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.787026 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.787180 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.787326 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.787465 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.787602 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.787763 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.787986 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.788139 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.788287 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.788493 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.788670 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.788912 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.789058 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.789225 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.789366 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.789557 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.789728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.789876 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.790016 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.790162 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.790311 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.790449 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.790586 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.790723 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.790873 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.791023 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.791169 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.791844 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.791994 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.792149 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.792374 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.792532 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.792687 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.792871 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.793021 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.793176 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.793334 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.793481 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.793641 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.793793 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.793938 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.794090 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.794244 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.794396 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.794542 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.794693 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.794844 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.795002 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.795155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.795627 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.795796 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.795979 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.796147 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.796302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.796447 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.796618 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.796799 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.796965 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.797112 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.797271 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.797424 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.797576 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.797721 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.797864 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.798045 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.798293 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.798444 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.798592 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.798738 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.798910 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.799136 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.799295 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.799452 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.799606 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.799753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.799905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.800071 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.800229 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.800380 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.800526 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.800677 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.800858 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.801023 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.801178 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.801323 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.801474 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.801619 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.801764 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.801917 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.802081 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.802243 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.802388 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.802534 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.802678 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.802834 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.802981 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.803124 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.803277 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.803431 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.803586 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.803730 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.803875 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.804033 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.804178 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.804322 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.804474 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.804619 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.804806 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.804985 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.805151 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.805304 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.805804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.805961 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.806117 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.806117 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.806414 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.806570 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.806716 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.806871 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.807016 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.807169 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.807321 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.807475 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.807475 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.807794 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.807941 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.808085 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.808262 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.808499 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.808499 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.808808 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.808980 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.809374 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.809537 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.809691 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.809837 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.809989 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.810144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.810299 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.810454 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.810611 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.810757 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.810902 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.811056 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.811201 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.811346 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.811498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.811643 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.811803 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.811950 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.812110 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.812290 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.812483 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.812650 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.812897 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.813065 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.813212 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.813357 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.813512 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.813709 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.813865 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.814019 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.814173 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.814326 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.814488 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.814642 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.814799 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.815408 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.816050 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.816259 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.816410 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.816565 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.816720 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.816903 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.817059 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.817217 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.817364 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.817836 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.817997 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.818157 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.818303 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.818463 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.818726 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.818885 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.819031 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.819176 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.819322 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.819322 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.819620 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.819768 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.819917 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.819917 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.820316 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.820477 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.820627 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.820810 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.821007 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.821166 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.821322 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.821468 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.821613 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.821767 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.821954 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.822104 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.822276 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.822424 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.822577 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.822722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.822916 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.823070 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.823225 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.823370 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.823515 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.823659 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.823810 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.824043 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.824190 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.824358 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.824504 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.824658 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.824838 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.825000 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.825154 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.825369 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.825518 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.825695 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.826190 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.826391 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.826604 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.826765 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.826910 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.827055 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.827209 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.827368 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.827523 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.827669 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.827814 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.827997 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.828157 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.828310 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.828456 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.828600 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.828897 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.829091 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.829309 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.829464 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.829610 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.829761 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.829907 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.830052 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.830244 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.830413 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.830606 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.830765 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.830947 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.831107 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.831263 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.831427 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.831682 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.831856 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.832008 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.832242 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.832402 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.832547 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.832699 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.832872 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.833051 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.833253 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.833422 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.833570 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.833714 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.833897 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.834043 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.834202 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.834358 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.834504 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.834656 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.834859 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.835018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.835173 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.835347 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.835613 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.835779 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.835941 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.836409 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.836569 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.836717 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.836924 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.837073 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.837224 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.837385 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.837541 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.837687 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.837843 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.837988 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.838133 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.838294 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.838440 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.838595 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.838748 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.838911 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.839138 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.839298 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.839298 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.839585 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.839739 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.839895 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.840053 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.840207 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.840367 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.840496 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.840589 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.840674 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.840795 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.840885 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.840988 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.841082 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.841169 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.841263 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.841362 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.841455 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.841540 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.841646 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.841728 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.841808 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.841895 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.841980 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.842071 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.842156 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.842249 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.842344 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.842430 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.842521 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.842615 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.842725 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.842807 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.842888 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.842962 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.843044 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.843123 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.843195 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.843275 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.843355 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.843428 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.843504 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.843583 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.843751 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.843834 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.843921 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.843994 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.844072 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.844152 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.844223 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.844303 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.844383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.844456 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.844533 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.844604 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.844674 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.844752 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.844848 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.844921 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.844990 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.845059 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.845147 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.845237 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.845331 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.845411 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.845489 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.845489 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.845623 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.845623 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.845765 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.845837 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.845913 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.845984 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.846053 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.846131 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.846202 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.846202 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.846337 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.846337 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.846491 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.846571 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.846641 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.846711 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.846787 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.846866 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.846946 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.847026 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.847110 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.847182 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.847251 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.847321 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.847399 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.847471 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.847548 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.847627 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.847717 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.847795 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.847880 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.847960 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.848031 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.848317 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.848391 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.848472 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.848544 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.848614 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.848691 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.848782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.848859 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.848950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.849030 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.849109 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.849187 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.849265 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.849335 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.849417 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.849496 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.849574 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.849651 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.849722 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.849791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.849870 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.849954 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.850032 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.850103 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.850206 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.850307 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.850382 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.850453 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.850531 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.850609 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.850680 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.850761 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.850833 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.850910 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.850991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.851063 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.851141 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.851225 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.851297 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.851366 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.851436 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.851513 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.851650 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.851725 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.851795 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.851871 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.851943 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.852013 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.852091 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.852170 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.852250 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.852328 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.852464 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.852582 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.852689 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.852846 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.852938 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.853021 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.853120 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.853220 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.853314 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.853398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.853481 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.853573 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.853672 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.853764 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.853857 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.853941 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.854026 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.854117 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.854215 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.854308 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.854401 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.854485 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.854569 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.854662 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.854761 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.854846 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.854929 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.855012 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.855099 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.855197 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.855282 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.855282 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.855442 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.855442 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.855595 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.855686 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.855771 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.855862 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.855954 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.856054 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.856139 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.856231 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.856358 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.856475 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.856592 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.856720 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.856830 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.856923 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.857010 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.857101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.857231 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.857332 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.857429 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.857514 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.857605 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.857691 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.857784 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.857906 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.858024 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.858134 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.858243 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.858351 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.858461 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.858559 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.858657 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.858742 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.858825 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.858918 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.859099 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.859257 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.859418 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.859568 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.859716 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.859864 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.860011 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.860172 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.860323 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.860478 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.860629 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.860837 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.860995 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.861173 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.861324 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.861473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.861622 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.861776 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.861925 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.862082 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.862230 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.862397 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.862555 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.862705 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.862853 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.863838 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.863942 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.864037 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.864123 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.864216 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.864310 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.864310 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.864310 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.864310 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.864630 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.864723 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.864843 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.864931 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.865013 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.865100 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.865191 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.865284 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.865383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.865469 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.865565 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.865658 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.865749 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.865834 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.865915 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.865994 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.866072 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.866151 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.866230 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.866314 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.866394 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.866474 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.866551 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.866622 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.866692 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.866835 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.866835 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.866967 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.867043 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.867114 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.867183 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.867266 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.867344 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.867421 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.867506 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.867588 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.867672 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.867763 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.867763 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.867763 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.867763 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.868071 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.868164 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.868250 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.868334 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.868427 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.868518 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.868611 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.868704 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.868889 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.868974 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.869070 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.869154 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.869253 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.869353 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.869447 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.869534 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.869616 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.869699 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.869788 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.869882 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.869975 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.870059 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.870150 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.870244 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.870345 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.870437 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.870522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.870604 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.870687 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.870776 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.870873 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.870958 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.871049 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.871174 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.871277 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.871498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.871600 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.871810 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.871917 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.872128 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.872229 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.872447 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.872548 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.872754 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.873023 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.873147 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.873356 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.873458 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.873675 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.873796 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.873989 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.874098 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.874302 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.874416 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.874614 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.874709 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.874989 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.875089 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.875307 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.875417 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.875621 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.875724 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.875936 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.876031 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.876247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.876345 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.876568 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.876692 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.876908 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.877001 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.877239 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.877348 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.877573 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.877672 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.877885 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.877994 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.878201 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.878300 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.878517 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.878623 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.878832 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.878939 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.879500 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.879600 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.879813 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.879919 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.880131 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.880240 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.880447 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.880547 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.880795 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.880906 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.881093 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.881186 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.881820 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.881933 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.882021 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.882114 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.882215 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.882308 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.882399 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.882491 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.882613 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.882715 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.882941 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.883047 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.883342 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.883442 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.883575 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.883677 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.883968 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.884067 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.884212 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.884370 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.884534 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.884708 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.884888 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.885071 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.885202 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.885401 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.885494 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.885733 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.886006 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.886110 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.886326 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.886417 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.886661 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.886753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.887014 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.887111 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.887276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.887500 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.887593 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.887666 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.887882 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.887984 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.888222 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.888315 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.888539 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.888803 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.888890 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.888975 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.889182 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.889275 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.889492 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.889583 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.889794 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.890118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.890461 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.890770 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.890865 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.891092 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.891188 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.891403 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.891498 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.891811 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.891969 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.892147 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.892308 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.892471 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.892623 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.892807 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.892963 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.893320 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.893447 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.893700 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.893864 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.893941 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.894028 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.894353 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.894450 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.894522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.894607 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.894849 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.894941 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.895109 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.895205 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.895396 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.895497 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.895671 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.895767 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.895979 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.896074 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.896290 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.896392 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.896594 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.896695 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.896922 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.897028 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.897316 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.897413 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.897597 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.897754 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.897907 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.898051 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.898205 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.898353 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.898506 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.898659 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.898812 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.898959 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.899129 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.899276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.899423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.899568 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.899721 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.899873 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.900033 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.900188 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.900342 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.900489 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.900636 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.900807 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.900978 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.901143 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.901290 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.901442 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.901589 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.901748 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.901896 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.902048 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.902204 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.902364 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.902520 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.902674 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.902830 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.902982 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.903145 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.903292 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.903531 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.903710 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.903950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.904104 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.904269 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.904507 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.904661 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.904836 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.904989 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.905142 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.905295 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.905451 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.905645 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.905795 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.905942 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.905942 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.906282 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.906282 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.906568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.906718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.906864 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.907009 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.907162 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.907405 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.907580 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.907738 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.907893 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.908039 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.908184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.908329 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.908489 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.908636 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.908821 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.908975 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.909265 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.909449 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.909618 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.909773 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.909935 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.910082 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.910237 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.910396 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.910543 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.910688 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.910834 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.910987 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.911135 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.911288 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.911445 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.911591 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.911743 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.911889 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.912045 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.912192 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.912347 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.912493 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.912639 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.912804 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.912974 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.913123 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.913276 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.913448 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.913677 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.913829 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.914002 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.914234 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.914393 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.914638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.914789 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.914945 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.915101 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.915249 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.915403 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.915566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.915720 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.915881 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.916029 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.916176 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.916322 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.916468 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.916629 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.916985 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.917150 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.917305 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.917548 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.917702 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.917869 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.918018 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.918165 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.918313 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.918466 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.918619 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.918775 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.918922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.919068 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.919213 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.919359 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.919504 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.919669 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.919823 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.919972 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.920124 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.920272 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.920431 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.920586 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.920741 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.920920 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.921075 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.921229 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.921384 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.921549 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.921734 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.921883 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.922037 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.922190 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.922349 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.922504 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.922657 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.922811 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.922958 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.923184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.923333 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.923490 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.923665 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.923880 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.924040 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.924202 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.924455 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.924607 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.924753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.925021 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.925255 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.925415 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.925564 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.925720 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.925884 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.926031 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.926176 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.926332 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.926485 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.926633 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.926786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.926933 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.927087 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.927233 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.927386 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.927561 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.927779 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.927949 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.928105 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.928253 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.928412 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.928561 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.928714 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.928915 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.929076 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.929223 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.929368 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.929520 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.929666 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.929813 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.929977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.930131 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.930286 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.930441 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.930586 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.930747 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.930895 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.931049 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.931202 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.931349 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.931501 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.931679 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.931931 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.932108 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.932256 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.932410 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.932564 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.932719 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.932888 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.933048 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.933195 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.933347 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.933494 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.933648 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.933802 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.934038 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.934189 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.934336 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.934505 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.934743 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.934961 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.935111 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.935289 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.935533 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.935792 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.935973 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.936125 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.936274 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.936442 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.936635 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.936825 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.936979 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.937134 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.937305 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.937524 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.937684 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.937929 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.938089 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.938245 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.938392 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.938548 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.938711 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.938863 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.939017 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.939171 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.939318 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.939463 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.940208 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.940378 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.940534 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.940682 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.940875 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.941036 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.941195 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.941350 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.941497 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.941650 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.941797 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.941962 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.942112 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.942257 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.942410 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.942557 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.942711 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.942871 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.943038 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.943184 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.943339 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.943493 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.943649 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.943803 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.943956 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.944183 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.944342 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.944490 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.944647 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.944905 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.945081 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.945236 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.945383 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.945557 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.945839 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.945998 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.946179 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.946332 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.946479 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.946625 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.946784 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.946932 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.947077 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.947234 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.947391 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.947558 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.947717 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.947864 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 31 18:36:25.948108 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.948108 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 18:36:25.948108 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 31 18:36:26.004735 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO dbcounter [None req-9eac2d38-3c7f-4a52-a4ae-f7c18cae3ad2 None None] Registered counter for database nova_api Jul 31 18:36:26.005179 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO dbcounter [None req-1e9bd578-be20-4913-89ca-a573dfa98e65 None None] Registered counter for database nova_api Jul 31 18:36:26.025872 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_db.sqlalchemy.engines [None req-1e9bd578-be20-4913-89ca-a573dfa98e65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 18:36:26.027369 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_db.sqlalchemy.engines [None req-9eac2d38-3c7f-4a52-a4ae-f7c18cae3ad2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 18:36:26.033895 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writer thread running {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 18:36:26.035918 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writer thread running {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 18:36:26.090134 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.context [None req-1e9bd578-be20-4913-89ca-a573dfa98e65 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ecbfed3-af85-4afe-b379-031f6ba6062f(cell1) {{(pid=124334) load_cells /opt/stack/nova/nova/context.py:464}} Jul 31 18:36:26.091112 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.context [None req-9eac2d38-3c7f-4a52-a4ae-f7c18cae3ad2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ecbfed3-af85-4afe-b379-031f6ba6062f(cell1) {{(pid=124333) load_cells /opt/stack/nova/nova/context.py:464}} Jul 31 18:36:26.094579 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1e9bd578-be20-4913-89ca-a573dfa98e65 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:36:26.095402 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9eac2d38-3c7f-4a52-a4ae-f7c18cae3ad2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:36:26.096203 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1e9bd578-be20-4913-89ca-a573dfa98e65 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:36:26.096996 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1e9bd578-be20-4913-89ca-a573dfa98e65 None None] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:36:26.097162 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9eac2d38-3c7f-4a52-a4ae-f7c18cae3ad2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:36:26.097850 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9eac2d38-3c7f-4a52-a4ae-f7c18cae3ad2 None None] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:36:26.099077 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1e9bd578-be20-4913-89ca-a573dfa98e65 None None] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:36:26.099869 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9eac2d38-3c7f-4a52-a4ae-f7c18cae3ad2 None None] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:36:26.101137 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO dbcounter [None req-1e9bd578-be20-4913-89ca-a573dfa98e65 None None] Registered counter for database nova_cell0 Jul 31 18:36:26.101921 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO dbcounter [None req-9eac2d38-3c7f-4a52-a4ae-f7c18cae3ad2 None None] Registered counter for database nova_cell0 Jul 31 18:36:26.105273 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO dbcounter [None req-1e9bd578-be20-4913-89ca-a573dfa98e65 None None] Registered counter for database nova_cell1 Jul 31 18:36:26.105974 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO dbcounter [None req-9eac2d38-3c7f-4a52-a4ae-f7c18cae3ad2 None None] Registered counter for database nova_cell1 Jul 31 18:36:26.112856 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_db.sqlalchemy.engines [None req-1e9bd578-be20-4913-89ca-a573dfa98e65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 18:36:26.114209 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_db.sqlalchemy.engines [None req-9eac2d38-3c7f-4a52-a4ae-f7c18cae3ad2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 18:36:26.116054 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_db.sqlalchemy.engines [None req-1e9bd578-be20-4913-89ca-a573dfa98e65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 18:36:26.117837 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_db.sqlalchemy.engines [None req-9eac2d38-3c7f-4a52-a4ae-f7c18cae3ad2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 18:36:26.121316 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writer thread running {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 18:36:26.122354 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writer thread running {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 18:36:26.123654 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writer thread running {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 18:36:26.262409 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writer thread running {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 18:36:26.269853 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO dbcounter [None req-1e9bd578-be20-4913-89ca-a573dfa98e65 None None] Registered counter for database nova_cell0 Jul 31 18:36:26.273793 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO dbcounter [None req-9eac2d38-3c7f-4a52-a4ae-f7c18cae3ad2 None None] Registered counter for database nova_cell0 Jul 31 18:36:26.277020 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_db.sqlalchemy.engines [None req-1e9bd578-be20-4913-89ca-a573dfa98e65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 18:36:26.280914 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_db.sqlalchemy.engines [None req-9eac2d38-3c7f-4a52-a4ae-f7c18cae3ad2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 18:36:26.282446 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writer thread running {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 18:36:26.285643 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writer thread running {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 18:36:26.598756 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: WARNING keystonemiddleware.auth_token [None req-1e9bd578-be20-4913-89ca-a573dfa98e65 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 18:36:26.605877 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: WARNING keystonemiddleware.auth_token [None req-9eac2d38-3c7f-4a52-a4ae-f7c18cae3ad2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 18:36:26.606159 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: WARNING keystonemiddleware.auth_token [None req-1e9bd578-be20-4913-89ca-a573dfa98e65 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 18:36:26.613237 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: WARNING keystonemiddleware.auth_token [None req-9eac2d38-3c7f-4a52-a4ae-f7c18cae3ad2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 18:36:26.948876 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: WARNING keystonemiddleware.auth_token [None req-1e9bd578-be20-4913-89ca-a573dfa98e65 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 18:36:26.955238 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: WARNING keystonemiddleware.auth_token [None req-1e9bd578-be20-4913-89ca-a573dfa98e65 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 18:36:26.960347 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557fb69a79c0 pid: 124334 (default app) Jul 31 18:36:26.970641 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: WARNING keystonemiddleware.auth_token [None req-9eac2d38-3c7f-4a52-a4ae-f7c18cae3ad2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 18:36:26.976680 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: WARNING keystonemiddleware.auth_token [None req-9eac2d38-3c7f-4a52-a4ae-f7c18cae3ad2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 18:36:26.982062 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557fb69a79c0 pid: 124333 (default app) Jul 31 18:37:07.292750 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=3 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:07.293614 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=3 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:07.293816 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell0:SELECT=3 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:07.294558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell0:SELECT=3 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:08.005199 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=3 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:08.006006 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell0:SELECT=3 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:08.006748 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=3 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:08.007454 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell0:SELECT=3 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:08.762495 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-baa3e108-106c-450f-bbd3-07ae2eaf566b tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] Action: 'create', calling method: .version_select at 0x7f870c13dee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-211688070", "metadata": {"Type": "work"}}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:37:08.770544 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-baa3e108-106c-450f-bbd3-07ae2eaf566b tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] Request method failure captured: Jul 31 18:37:08.770544 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 31 18:37:08.770544 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:37:08.770544 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:37:08.770544 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:37:08.770544 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 121 Jul 31 18:37:08.770544 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:37:08.770544 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:37:08.770544 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:37:08.770544 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:37:08.770544 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5svThkyWzD59uYL7ABMNrkj1Gvp1moV9hTmud1UEZcolaHUtMQxpXDgvhQaA84xPPFTtm5z5lw6q3vDXNJtKiupgXHhXY_VqaZxplnU_upvcxInCRFf-ZEQgmQBZPaWu7m4RDI3bhUoVjUc9o8yDPuX0JtvLwKINu-FXQ_cANCBQ1kc Jul 31 18:37:08.770544 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:37:08.770544 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:37:08.770544 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:37:08.770544 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:37:08.770544 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:37:08.770544 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:37:08.770544 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: df41262534584aa1930c9960bde9d2a8 Jul 31 18:37:08.770544 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-VolumesNegativeTest-1940456888 Jul 31 18:37:08.770544 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:37:08.770544 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:37:08.772562 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/df41262534584aa1930c9960bde9d2a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_df41262534584aa1930c9960bde9d2a8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/df41262534584aa1930c9960bde9d2a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/df41262534584aa1930c9960bde9d2a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:37:08.772562 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-VolumesNegativeTest-1940456888 Jul 31 18:37:08.772562 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: df41262534584aa1930c9960bde9d2a8 Jul 31 18:37:08.772562 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-VolumesNegativeTest-1940456888 Jul 31 18:37:08.772562 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-VolumesNegativeTest-1940456888-project Jul 31 18:37:08.772562 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:37:08.772562 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:37:08.772562 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: 6e196cc129c342628a657636e0a3610f Jul 31 18:37:08.772562 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-VolumesNegativeTest-1940456888-project Jul 31 18:37:08.772562 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Jul 31 18:37:08.772562 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-211688070", "metadata": {"Type": "work"}}} Jul 31 18:37:08.772562 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: Jul 31 18:37:08.772562 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 31 18:37:08.773454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-211688070', 'metadata': {'Type': 'work'}}}} Jul 31 18:37:08.773454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:37:08.773454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:08.773454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 18:37:08.773454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 18:37:08.773454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 18:37:08.773454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise error Jul 31 18:37:08.773454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 31 18:37:08.773454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:08.773454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 31 18:37:08.773454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 31 18:37:08.773454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:08.773454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 31 18:37:08.773454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi '#$%' Jul 31 18:37:08.773454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:08.773454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:08.773454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:08.773454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:08.773454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:37:08.773454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:37:08.773454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:37:08.773454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:37:08.774905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 18:37:08.774905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 18:37:08.774905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:37:08.774905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:37:08.774905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 18:37:08.774905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 18:37:08.774905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 18:37:08.774905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 18:37:08.774905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 18:37:08.774905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 18:37:08.774905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 31 18:37:08.774905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:08.774905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:08.774905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:08.774905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:08.774905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:37:08.774905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:37:08.774905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 18:37:08.774905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 18:37:08.776028 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 31 18:37:08.776028 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:08.778720 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-baa3e108-106c-450f-bbd3-07ae2eaf566b tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:37:08.780634 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-baa3e108-106c-450f-bbd3-07ae2eaf566b tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.504633 Jul 31 18:37:08.782110 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1156 bytes} [Sun Jul 31 18:37:07 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1507 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 18:37:08.871480 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-7ed16ce8-f9ba-4719-b0d3-7d45e9281d24 tempest-VolumesGetTestJSON-1367260828 tempest-VolumesGetTestJSON-1367260828-project] Action: 'create', calling method: .version_select at 0x7f870c051670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1485310508", "metadata": {"Type": "work"}}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:37:08.912998 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-0fc12d37-cd88-4967-a748-1a6f24545c2a tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] Action: 'create', calling method: .version_select at 0x7f870c13fee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1085266824"}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:37:09.993435 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-0fc12d37-cd88-4967-a748-1a6f24545c2a tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.993958 Jul 31 18:37:09.994803 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 1/2] 10.222.0.49 () {60 vars in 1155 bytes} [Sun Jul 31 18:37:07 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1997 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 31 18:37:10.000972 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-aaa9364a-e2a7-4604-8d74-befcb84dcbf4 tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] Action: 'create', calling method: .version_select at 0x7f870bfc0ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-106612959", "metadata": {"Type": "work"}}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:37:10.011434 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-aaa9364a-e2a7-4604-8d74-befcb84dcbf4 tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] Request method failure captured: Jul 31 18:37:10.011434 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 31 18:37:10.011434 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:37:10.011434 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:37:10.011434 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:37:10.011434 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 119 Jul 31 18:37:10.011434 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:37:10.011434 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:37:10.011434 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:37:10.011434 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:37:10.011434 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5svThkyWzD59uYL7ABMNrkj1Gvp1moV9hTmud1UEZcolaHUtMQxpXDgvhQaA84xPPFTtm5z5lw6q3vDXNJtKiupgXHhXY_VqaZxplnU_upvcxInCRFf-ZEQgmQBZPaWu7m4RDI3bhUoVjUc9o8yDPuX0JtvLwKINu-FXQ_cANCBQ1kc Jul 31 18:37:10.011434 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:37:10.011434 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:37:10.011434 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:37:10.011434 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:37:10.011434 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:37:10.011434 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:37:10.011434 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: df41262534584aa1930c9960bde9d2a8 Jul 31 18:37:10.011434 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-VolumesNegativeTest-1940456888 Jul 31 18:37:10.011434 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:37:10.011434 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:37:10.013087 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/df41262534584aa1930c9960bde9d2a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_df41262534584aa1930c9960bde9d2a8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/df41262534584aa1930c9960bde9d2a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/df41262534584aa1930c9960bde9d2a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:37:10.013087 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-VolumesNegativeTest-1940456888 Jul 31 18:37:10.013087 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: df41262534584aa1930c9960bde9d2a8 Jul 31 18:37:10.013087 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-VolumesNegativeTest-1940456888 Jul 31 18:37:10.013087 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-VolumesNegativeTest-1940456888-project Jul 31 18:37:10.013087 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:37:10.013087 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:37:10.013087 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 6e196cc129c342628a657636e0a3610f Jul 31 18:37:10.013087 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-VolumesNegativeTest-1940456888-project Jul 31 18:37:10.013087 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Jul 31 18:37:10.013087 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-106612959", "metadata": {"Type": "work"}}} Jul 31 18:37:10.013087 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: Jul 31 18:37:10.013087 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 31 18:37:10.014296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-106612959', 'metadata': {'Type': 'work'}}}} Jul 31 18:37:10.014296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:37:10.014296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:10.014296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 18:37:10.014296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 18:37:10.014296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 18:37:10.014296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise error Jul 31 18:37:10.014296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 31 18:37:10.014296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.014296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 31 18:37:10.014296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 31 18:37:10.014296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.014296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 31 18:37:10.014296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi '0' Jul 31 18:37:10.014296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.014296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:10.014296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.014296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:10.014296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:37:10.014296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:37:10.014296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:37:10.014296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:37:10.016647 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 18:37:10.016647 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 18:37:10.016647 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:37:10.016647 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:37:10.016647 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 18:37:10.016647 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 18:37:10.016647 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 18:37:10.016647 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 18:37:10.016647 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 18:37:10.016647 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 18:37:10.016647 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 31 18:37:10.016647 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.016647 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:10.016647 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.016647 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:10.016647 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:37:10.016647 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:37:10.016647 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 18:37:10.016647 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 18:37:10.018841 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 31 18:37:10.018841 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.027702 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-aaa9364a-e2a7-4604-8d74-befcb84dcbf4 tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:37:10.029423 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-aaa9364a-e2a7-4604-8d74-befcb84dcbf4 tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.033321 Jul 31 18:37:10.030892 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 2/3] 10.222.0.49 () {60 vars in 1156 bytes} [Sun Jul 31 18:37:09 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 18:37:10.039078 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-0a3b97b6-9b08-4816-9488-dd5d2145008a tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] Calling method '.version_select at 0x7f870bf8e700>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:10.098601 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-0a3b97b6-9b08-4816-9488-dd5d2145008a tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/1136ec19-d8b1-4160-a490-3fc84e4641e4" status: 200 len: 345 microversion: 2.1 time: 0.065650 Jul 31 18:37:10.099481 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 3/4] 10.222.0.49 () {58 vars in 1245 bytes} [Sun Jul 31 18:37:10 2022] GET /compute/v2.1/os-volumes/1136ec19-d8b1-4160-a490-3fc84e4641e4 => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:37:10.115415 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-6d9b32c0-44f7-4dd2-8632-422734bf037c tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] Action: 'create', calling method: .version_select at 0x7f870bfcf790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1685599142", "metadata": {"Type": "work"}}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:37:10.122783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-6d9b32c0-44f7-4dd2-8632-422734bf037c tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] Request method failure captured: Jul 31 18:37:10.122783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 31 18:37:10.122783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:37:10.122783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:37:10.122783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:37:10.122783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 119 Jul 31 18:37:10.122783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:37:10.122783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:37:10.122783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:37:10.122783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:37:10.122783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5svThkyWzD59uYL7ABMNrkj1Gvp1moV9hTmud1UEZcolaHUtMQxpXDgvhQaA84xPPFTtm5z5lw6q3vDXNJtKiupgXHhXY_VqaZxplnU_upvcxInCRFf-ZEQgmQBZPaWu7m4RDI3bhUoVjUc9o8yDPuX0JtvLwKINu-FXQ_cANCBQ1kc Jul 31 18:37:10.122783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:37:10.122783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:37:10.122783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:37:10.122783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:37:10.122783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:37:10.122783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:37:10.122783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: df41262534584aa1930c9960bde9d2a8 Jul 31 18:37:10.122783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-VolumesNegativeTest-1940456888 Jul 31 18:37:10.122783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:37:10.122783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:37:10.124625 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/df41262534584aa1930c9960bde9d2a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_df41262534584aa1930c9960bde9d2a8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/df41262534584aa1930c9960bde9d2a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/df41262534584aa1930c9960bde9d2a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:37:10.124625 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-VolumesNegativeTest-1940456888 Jul 31 18:37:10.124625 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: df41262534584aa1930c9960bde9d2a8 Jul 31 18:37:10.124625 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-VolumesNegativeTest-1940456888 Jul 31 18:37:10.124625 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-VolumesNegativeTest-1940456888-project Jul 31 18:37:10.124625 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:37:10.124625 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:37:10.124625 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 6e196cc129c342628a657636e0a3610f Jul 31 18:37:10.124625 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-VolumesNegativeTest-1940456888-project Jul 31 18:37:10.124625 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Jul 31 18:37:10.124625 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1685599142", "metadata": {"Type": "work"}}} Jul 31 18:37:10.124625 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: Jul 31 18:37:10.124625 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 31 18:37:10.125587 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1685599142', 'metadata': {'Type': 'work'}}}} Jul 31 18:37:10.125587 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:37:10.125587 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:10.125587 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 18:37:10.125587 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 18:37:10.125587 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 18:37:10.125587 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise error Jul 31 18:37:10.125587 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 31 18:37:10.125587 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.125587 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 31 18:37:10.125587 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 31 18:37:10.125587 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.125587 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 31 18:37:10.125587 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi '' Jul 31 18:37:10.125587 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.125587 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:10.125587 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.125587 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:10.125587 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:37:10.125587 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:37:10.125587 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:37:10.125587 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:37:10.127001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 18:37:10.127001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 18:37:10.127001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:37:10.127001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:37:10.127001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 18:37:10.127001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 18:37:10.127001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 18:37:10.127001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 18:37:10.127001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 18:37:10.127001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 18:37:10.127001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 31 18:37:10.127001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.127001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:10.127001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.127001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:10.127001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:37:10.127001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:37:10.127001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 18:37:10.127001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 18:37:10.128170 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 31 18:37:10.128170 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.128170 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-6d9b32c0-44f7-4dd2-8632-422734bf037c tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:37:10.128606 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-6d9b32c0-44f7-4dd2-8632-422734bf037c tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.025956 Jul 31 18:37:10.129649 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 4/5] 10.222.0.49 () {60 vars in 1156 bytes} [Sun Jul 31 18:37:10 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 18:37:10.138945 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-a2a50707-dfc8-48e1-b498-59111957cc5b tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] Calling method '.version_select at 0x7f870bf8e940>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:10.173004 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-a2a50707-dfc8-48e1-b498-59111957cc5b tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] HTTP exception thrown: Volume tempest-invalid-650374323 could not be found. Jul 31 18:37:10.177922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-a2a50707-dfc8-48e1-b498-59111957cc5b tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] Request method failure captured: Jul 31 18:37:10.177922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-650374323 HTTP/1.1 Jul 31 18:37:10.177922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:37:10.177922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:37:10.177922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:37:10.177922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:37:10.177922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:37:10.177922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:37:10.177922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:37:10.177922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:37:10.177922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5svThkyWzD59uYL7ABMNrkj1Gvp1moV9hTmud1UEZcolaHUtMQxpXDgvhQaA84xPPFTtm5z5lw6q3vDXNJtKiupgXHhXY_VqaZxplnU_upvcxInCRFf-ZEQgmQBZPaWu7m4RDI3bhUoVjUc9o8yDPuX0JtvLwKINu-FXQ_cANCBQ1kc Jul 31 18:37:10.177922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:37:10.177922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:37:10.177922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:37:10.177922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:37:10.177922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:37:10.177922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:37:10.177922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: df41262534584aa1930c9960bde9d2a8 Jul 31 18:37:10.177922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-VolumesNegativeTest-1940456888 Jul 31 18:37:10.177922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:37:10.177922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:37:10.179463 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/df41262534584aa1930c9960bde9d2a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_df41262534584aa1930c9960bde9d2a8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/df41262534584aa1930c9960bde9d2a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/df41262534584aa1930c9960bde9d2a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:37:10.179463 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-VolumesNegativeTest-1940456888 Jul 31 18:37:10.179463 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: df41262534584aa1930c9960bde9d2a8 Jul 31 18:37:10.179463 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-VolumesNegativeTest-1940456888 Jul 31 18:37:10.179463 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-VolumesNegativeTest-1940456888-project Jul 31 18:37:10.179463 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:37:10.179463 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:37:10.179463 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 6e196cc129c342628a657636e0a3610f Jul 31 18:37:10.179463 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-VolumesNegativeTest-1940456888-project Jul 31 18:37:10.179463 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: Jul 31 18:37:10.179463 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Volume tempest-invalid-650374323 could not be found. Jul 31 18:37:10.179463 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': 'tempest-invalid-650374323'} Jul 31 18:37:10.179463 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:37:10.180527 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:10.180527 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 18:37:10.180527 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 18:37:10.180527 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 31 18:37:10.180527 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 31 18:37:10.180527 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 31 18:37:10.180527 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 31 18:37:10.180527 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 31 18:37:10.180527 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 31 18:37:10.180527 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 31 18:37:10.180527 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 31 18:37:10.180527 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 18:37:10.180527 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 18:37:10.180527 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 18:37:10.180527 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 18:37:10.180527 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-650374323 could not be found. (HTTP 404) (Request-ID: req-f9a19c0f-74da-4533-9180-9117c8c0536b) Jul 31 18:37:10.180527 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.180527 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:10.180527 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.182011 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:10.182011 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 31 18:37:10.182011 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 31 18:37:10.182011 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 18:37:10.182011 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 18:37:10.182011 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 18:37:10.182011 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 18:37:10.182011 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 18:37:10.182011 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 18:37:10.182011 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 18:37:10.182011 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 18:37:10.182011 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 31 18:37:10.182011 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 31 18:37:10.182011 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 31 18:37:10.182011 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 31 18:37:10.182011 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 31 18:37:10.182011 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 31 18:37:10.182011 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 31 18:37:10.182011 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 31 18:37:10.183276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 18:37:10.183276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 18:37:10.183276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 18:37:10.183276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 18:37:10.183276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-650374323 could not be found. Jul 31 18:37:10.183276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.183276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:10.183276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.183276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:10.183276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:37:10.183276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:37:10.183276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:37:10.183276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:37:10.183276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 18:37:10.183276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 18:37:10.183276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:37:10.183276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:37:10.183276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 31 18:37:10.183276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:37:10.183276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-650374323 could not be found. Jul 31 18:37:10.184786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.184786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:10.184786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.184786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:10.184786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:37:10.184786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:37:10.184786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:37:10.184786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:37:10.184786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-650374323 could not be found. Jul 31 18:37:10.184786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.186656 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-a2a50707-dfc8-48e1-b498-59111957cc5b tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] Returning 404 to user: Volume tempest-invalid-650374323 could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:37:10.187641 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-a2a50707-dfc8-48e1-b498-59111957cc5b tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-650374323" status: 404 len: 98 microversion: 2.1 time: 0.052861 Jul 31 18:37:10.188356 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 5/6] 10.222.0.49 () {58 vars in 1215 bytes} [Sun Jul 31 18:37:10 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-650374323 => generated 98 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 18:37:10.200642 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-0663b499-d47d-4dfe-90f2-d20a2bafdfe5 tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005873 Jul 31 18:37:10.201190 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 6/7] 10.222.0.49 () {58 vars in 1140 bytes} [Sun Jul 31 18:37:10 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 31 18:37:10.226116 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-1ee81a30-7d49-4913-82d9-914bcadd7304 tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015802 Jul 31 18:37:10.233080 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 7/8] 10.222.0.49 () {58 vars in 1137 bytes} [Sun Jul 31 18:37:10 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 31 18:37:10.245160 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-f4cde72f-2b66-4cf8-98b0-6d1d8dd42492 tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] Calling method '.version_select at 0x7f870bf8ee50>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:10.290433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-f4cde72f-2b66-4cf8-98b0-6d1d8dd42492 tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] HTTP exception thrown: Volume 243cd5b1-726b-4b2e-ae45-389637c38ce5 could not be found. Jul 31 18:37:10.292610 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-f4cde72f-2b66-4cf8-98b0-6d1d8dd42492 tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] Request method failure captured: Jul 31 18:37:10.292610 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: DELETE /compute/v2.1/os-volumes/243cd5b1-726b-4b2e-ae45-389637c38ce5 HTTP/1.1 Jul 31 18:37:10.292610 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:37:10.292610 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:37:10.292610 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:37:10.292610 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:37:10.292610 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:37:10.292610 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:37:10.292610 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:37:10.292610 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:37:10.292610 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5svThkyWzD59uYL7ABMNrkj1Gvp1moV9hTmud1UEZcolaHUtMQxpXDgvhQaA84xPPFTtm5z5lw6q3vDXNJtKiupgXHhXY_VqaZxplnU_upvcxInCRFf-ZEQgmQBZPaWu7m4RDI3bhUoVjUc9o8yDPuX0JtvLwKINu-FXQ_cANCBQ1kc Jul 31 18:37:10.292610 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:37:10.292610 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:37:10.292610 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:37:10.292610 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:37:10.292610 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:37:10.292610 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:37:10.292610 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: df41262534584aa1930c9960bde9d2a8 Jul 31 18:37:10.292610 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-VolumesNegativeTest-1940456888 Jul 31 18:37:10.292610 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:37:10.292610 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:37:10.294184 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/df41262534584aa1930c9960bde9d2a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_df41262534584aa1930c9960bde9d2a8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/df41262534584aa1930c9960bde9d2a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/df41262534584aa1930c9960bde9d2a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:37:10.294184 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-VolumesNegativeTest-1940456888 Jul 31 18:37:10.294184 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: df41262534584aa1930c9960bde9d2a8 Jul 31 18:37:10.294184 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-VolumesNegativeTest-1940456888 Jul 31 18:37:10.294184 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-VolumesNegativeTest-1940456888-project Jul 31 18:37:10.294184 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:37:10.294184 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:37:10.294184 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 6e196cc129c342628a657636e0a3610f Jul 31 18:37:10.294184 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-VolumesNegativeTest-1940456888-project Jul 31 18:37:10.294184 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: Jul 31 18:37:10.294184 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Volume 243cd5b1-726b-4b2e-ae45-389637c38ce5 could not be found. Jul 31 18:37:10.294184 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': '243cd5b1-726b-4b2e-ae45-389637c38ce5'} Jul 31 18:37:10.294184 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:37:10.295155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:10.295155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 18:37:10.295155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 18:37:10.295155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 31 18:37:10.295155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 31 18:37:10.295155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 31 18:37:10.295155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 31 18:37:10.295155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 31 18:37:10.295155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 31 18:37:10.295155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 31 18:37:10.295155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 31 18:37:10.295155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 18:37:10.295155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 18:37:10.295155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 18:37:10.295155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 18:37:10.295155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 243cd5b1-726b-4b2e-ae45-389637c38ce5 could not be found. (HTTP 404) (Request-ID: req-218f21c1-baea-4743-b5fc-e2cb1497ccdf) Jul 31 18:37:10.295155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.295155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:10.295155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.296561 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:10.296561 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 31 18:37:10.296561 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 31 18:37:10.296561 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 18:37:10.296561 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 18:37:10.296561 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 18:37:10.296561 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 18:37:10.296561 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 18:37:10.296561 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 18:37:10.296561 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 18:37:10.296561 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 18:37:10.296561 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 31 18:37:10.296561 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 31 18:37:10.296561 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 31 18:37:10.296561 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 31 18:37:10.296561 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 31 18:37:10.296561 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 31 18:37:10.296561 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 31 18:37:10.296561 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 31 18:37:10.297786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 18:37:10.297786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 18:37:10.297786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 18:37:10.297786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 18:37:10.297786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 243cd5b1-726b-4b2e-ae45-389637c38ce5 could not be found. Jul 31 18:37:10.297786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.297786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:10.297786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.297786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:10.297786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:37:10.297786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:37:10.297786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:37:10.297786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:37:10.297786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 18:37:10.297786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 18:37:10.297786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:37:10.297786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:37:10.297786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 31 18:37:10.297786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:37:10.299956 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 243cd5b1-726b-4b2e-ae45-389637c38ce5 could not be found. Jul 31 18:37:10.299956 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.299956 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:10.299956 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.299956 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:10.299956 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:37:10.299956 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:37:10.299956 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:37:10.299956 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:37:10.299956 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 243cd5b1-726b-4b2e-ae45-389637c38ce5 could not be found. Jul 31 18:37:10.299956 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.303510 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-f4cde72f-2b66-4cf8-98b0-6d1d8dd42492 tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] Returning 404 to user: Volume 243cd5b1-726b-4b2e-ae45-389637c38ce5 could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:37:10.303510 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-f4cde72f-2b66-4cf8-98b0-6d1d8dd42492 tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/243cd5b1-726b-4b2e-ae45-389637c38ce5" status: 404 len: 109 microversion: 2.1 time: 0.065343 Jul 31 18:37:10.303510 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 8/9] 10.222.0.49 () {58 vars in 1248 bytes} [Sun Jul 31 18:37:10 2022] DELETE /compute/v2.1/os-volumes/243cd5b1-726b-4b2e-ae45-389637c38ce5 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:37:10.313630 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-f026a3cf-1122-49da-bd0a-f6013f931fdd tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] Calling method '.version_select at 0x7f870bf8e5e0>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:10.326637 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-7ed16ce8-f9ba-4719-b0d3-7d45e9281d24 tempest-VolumesGetTestJSON-1367260828 tempest-VolumesGetTestJSON-1367260828-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.542349 Jul 31 18:37:10.327347 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 2/10] 10.222.0.49 () {60 vars in 1156 bytes} [Sun Jul 31 18:37:08 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1544 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 31 18:37:10.347307 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-04f82404-d3f1-46cb-9eb2-2c3258787f72 tempest-VolumesGetTestJSON-1367260828 tempest-VolumesGetTestJSON-1367260828-project] Calling method '.version_select at 0x7f870bf7c3a0>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:10.354528 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-f026a3cf-1122-49da-bd0a-f6013f931fdd tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] HTTP exception thrown: Volume f5ee7261-9852-4654-8a39-4b6f2a1daef5 could not be found. Jul 31 18:37:10.357172 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-f026a3cf-1122-49da-bd0a-f6013f931fdd tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] Request method failure captured: Jul 31 18:37:10.357172 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: GET /compute/v2.1/os-volumes/f5ee7261-9852-4654-8a39-4b6f2a1daef5 HTTP/1.1 Jul 31 18:37:10.357172 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:37:10.357172 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:37:10.357172 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:37:10.357172 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:37:10.357172 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:37:10.357172 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:37:10.357172 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:37:10.357172 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:37:10.357172 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5svThkyWzD59uYL7ABMNrkj1Gvp1moV9hTmud1UEZcolaHUtMQxpXDgvhQaA84xPPFTtm5z5lw6q3vDXNJtKiupgXHhXY_VqaZxplnU_upvcxInCRFf-ZEQgmQBZPaWu7m4RDI3bhUoVjUc9o8yDPuX0JtvLwKINu-FXQ_cANCBQ1kc Jul 31 18:37:10.357172 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:37:10.357172 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:37:10.357172 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:37:10.357172 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:37:10.357172 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:37:10.357172 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:37:10.357172 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: df41262534584aa1930c9960bde9d2a8 Jul 31 18:37:10.357172 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-VolumesNegativeTest-1940456888 Jul 31 18:37:10.357172 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:37:10.357172 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:37:10.358524 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/df41262534584aa1930c9960bde9d2a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_df41262534584aa1930c9960bde9d2a8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/df41262534584aa1930c9960bde9d2a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/df41262534584aa1930c9960bde9d2a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:37:10.358524 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-VolumesNegativeTest-1940456888 Jul 31 18:37:10.358524 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: df41262534584aa1930c9960bde9d2a8 Jul 31 18:37:10.358524 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-VolumesNegativeTest-1940456888 Jul 31 18:37:10.358524 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-VolumesNegativeTest-1940456888-project Jul 31 18:37:10.358524 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:37:10.358524 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:37:10.358524 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 6e196cc129c342628a657636e0a3610f Jul 31 18:37:10.358524 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-VolumesNegativeTest-1940456888-project Jul 31 18:37:10.358524 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: Jul 31 18:37:10.358524 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Volume f5ee7261-9852-4654-8a39-4b6f2a1daef5 could not be found. Jul 31 18:37:10.358524 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': 'f5ee7261-9852-4654-8a39-4b6f2a1daef5'} Jul 31 18:37:10.358524 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:37:10.359297 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:10.359297 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 18:37:10.359297 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 18:37:10.359297 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 18:37:10.359297 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 18:37:10.359297 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 18:37:10.359297 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 18:37:10.359297 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 18:37:10.359297 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 18:37:10.359297 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 18:37:10.359297 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 18:37:10.359297 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 18:37:10.359297 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 18:37:10.359297 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 18:37:10.359297 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 18:37:10.359297 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f5ee7261-9852-4654-8a39-4b6f2a1daef5 could not be found. (HTTP 404) (Request-ID: req-c4baa9ad-7c29-43d1-baf7-9fd90de5acee) Jul 31 18:37:10.359297 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.359297 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:10.359297 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.360472 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:10.360472 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 31 18:37:10.360472 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 31 18:37:10.360472 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 18:37:10.360472 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 18:37:10.360472 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 18:37:10.360472 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 18:37:10.360472 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 18:37:10.360472 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 18:37:10.360472 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 18:37:10.360472 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 18:37:10.360472 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 18:37:10.360472 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 18:37:10.360472 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 18:37:10.360472 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 18:37:10.360472 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 18:37:10.360472 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 18:37:10.360472 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 18:37:10.360472 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 18:37:10.362407 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 18:37:10.362407 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 18:37:10.362407 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 18:37:10.362407 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 18:37:10.362407 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f5ee7261-9852-4654-8a39-4b6f2a1daef5 could not be found. Jul 31 18:37:10.362407 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.362407 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:10.362407 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.362407 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:10.362407 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:37:10.362407 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:37:10.362407 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:37:10.362407 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:37:10.362407 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 18:37:10.362407 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 18:37:10.362407 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:37:10.362407 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:37:10.362407 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 31 18:37:10.362407 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:37:10.364415 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f5ee7261-9852-4654-8a39-4b6f2a1daef5 could not be found. Jul 31 18:37:10.364415 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.364415 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:10.364415 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.364415 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:10.364415 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:37:10.364415 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:37:10.364415 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:37:10.364415 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:37:10.364415 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f5ee7261-9852-4654-8a39-4b6f2a1daef5 could not be found. Jul 31 18:37:10.364415 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:10.373950 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-f026a3cf-1122-49da-bd0a-f6013f931fdd tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] Returning 404 to user: Volume f5ee7261-9852-4654-8a39-4b6f2a1daef5 could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:37:10.375043 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-f026a3cf-1122-49da-bd0a-f6013f931fdd tempest-VolumesNegativeTest-1940456888 tempest-VolumesNegativeTest-1940456888-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f5ee7261-9852-4654-8a39-4b6f2a1daef5" status: 404 len: 109 microversion: 2.1 time: 0.065594 Jul 31 18:37:10.378337 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 9/11] 10.222.0.49 () {58 vars in 1245 bytes} [Sun Jul 31 18:37:10 2022] GET /compute/v2.1/os-volumes/f5ee7261-9852-4654-8a39-4b6f2a1daef5 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:37:10.468070 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-04f82404-d3f1-46cb-9eb2-2c3258787f72 tempest-VolumesGetTestJSON-1367260828 tempest-VolumesGetTestJSON-1367260828-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/429ab2b7-c5ec-45c0-91c4-3c5e6f57d88f" status: 200 len: 353 microversion: 2.1 time: 0.126038 Jul 31 18:37:10.469236 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 3/12] 10.222.0.49 () {58 vars in 1245 bytes} [Sun Jul 31 18:37:10 2022] GET /compute/v2.1/os-volumes/429ab2b7-c5ec-45c0-91c4-3c5e6f57d88f => generated 353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:37:11.112489 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-9f9890bf-9d6b-4122-b32a-14d8eeae5d82 tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] Calling method '.version_select at 0x7f870bf8e280>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:11.205039 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-9f9890bf-9d6b-4122-b32a-14d8eeae5d82 tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/1136ec19-d8b1-4160-a490-3fc84e4641e4" status: 200 len: 346 microversion: 2.1 time: 0.096396 Jul 31 18:37:11.205600 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 10/13] 10.222.0.49 () {58 vars in 1245 bytes} [Sun Jul 31 18:37:11 2022] GET /compute/v2.1/os-volumes/1136ec19-d8b1-4160-a490-3fc84e4641e4 => generated 346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:37:11.218502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4bd8c302-4673-4152-b8b8-5d3dd96fc31f tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] Action: 'create', calling method: .version_select at 0x7f870bf7c9d0>, body: {"snapshot": {"volume_id": "1136ec19-d8b1-4160-a490-3fc84e4641e4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-571087096"}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:37:11.482323 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-44287c58-edb6-4b3f-aaee-d190974d6888 tempest-VolumesGetTestJSON-1367260828 tempest-VolumesGetTestJSON-1367260828-project] Calling method '.version_select at 0x7f870bf648b0>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:11.566507 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-44287c58-edb6-4b3f-aaee-d190974d6888 tempest-VolumesGetTestJSON-1367260828 tempest-VolumesGetTestJSON-1367260828-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/429ab2b7-c5ec-45c0-91c4-3c5e6f57d88f" status: 200 len: 354 microversion: 2.1 time: 0.088298 Jul 31 18:37:11.574422 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 11/14] 10.222.0.49 () {58 vars in 1245 bytes} [Sun Jul 31 18:37:11 2022] GET /compute/v2.1/os-volumes/429ab2b7-c5ec-45c0-91c4-3c5e6f57d88f => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:37:11.581003 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-04918bff-88fb-4667-9eaf-e26f6849fe82 tempest-VolumesGetTestJSON-1367260828 tempest-VolumesGetTestJSON-1367260828-project] Calling method '.version_select at 0x7f870bf8e280>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:11.680902 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-04918bff-88fb-4667-9eaf-e26f6849fe82 tempest-VolumesGetTestJSON-1367260828 tempest-VolumesGetTestJSON-1367260828-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/429ab2b7-c5ec-45c0-91c4-3c5e6f57d88f" status: 200 len: 354 microversion: 2.1 time: 0.103485 Jul 31 18:37:11.681747 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 12/15] 10.222.0.49 () {58 vars in 1245 bytes} [Sun Jul 31 18:37:11 2022] GET /compute/v2.1/os-volumes/429ab2b7-c5ec-45c0-91c4-3c5e6f57d88f => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:37:11.691152 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-4bd8c302-4673-4152-b8b8-5d3dd96fc31f tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.477074 Jul 31 18:37:11.692502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 4/16] 10.222.0.49 () {60 vars in 1162 bytes} [Sun Jul 31 18:37:11 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:37:11.704221 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-124d4677-5b11-4eeb-b48d-9352d6b2c457 tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] Calling method '.version_select at 0x7f870bf7cd30>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:11.708521 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-a5f46e7f-2688-4368-8448-5f732db6dbe1 tempest-VolumesGetTestJSON-1367260828 tempest-VolumesGetTestJSON-1367260828-project] Calling method '.version_select at 0x7f870bf8ee50>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:11.779165 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-124d4677-5b11-4eeb-b48d-9352d6b2c457 tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/f0e7f330-9fa8-432b-adad-eb01bb8abde1" status: 200 len: 286 microversion: 2.1 time: 0.078645 Jul 31 18:37:11.780360 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 5/17] 10.222.0.49 () {58 vars in 1251 bytes} [Sun Jul 31 18:37:11 2022] GET /compute/v2.1/os-snapshots/f0e7f330-9fa8-432b-adad-eb01bb8abde1 => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:37:11.791871 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f6c76a25-519d-48ec-ab1d-2c40b071c35a tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] Calling method '.version_select at 0x7f870bf7c4c0>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:11.838379 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-a5f46e7f-2688-4368-8448-5f732db6dbe1 tempest-VolumesGetTestJSON-1367260828 tempest-VolumesGetTestJSON-1367260828-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/429ab2b7-c5ec-45c0-91c4-3c5e6f57d88f" status: 202 len: 0 microversion: 2.1 time: 0.139127 Jul 31 18:37:11.839895 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 13/18] 10.222.0.49 () {58 vars in 1248 bytes} [Sun Jul 31 18:37:11 2022] DELETE /compute/v2.1/os-volumes/429ab2b7-c5ec-45c0-91c4-3c5e6f57d88f => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:37:11.847127 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-1f94bb1c-d7bd-4b45-b50e-b7de9cef1bef tempest-VolumesGetTestJSON-1367260828 tempest-VolumesGetTestJSON-1367260828-project] Calling method '.version_select at 0x7f870bf64a60>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:11.865391 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-f6c76a25-519d-48ec-ab1d-2c40b071c35a tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.077322 Jul 31 18:37:11.866283 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 6/19] 10.222.0.49 () {58 vars in 1140 bytes} [Sun Jul 31 18:37:11 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:37:11.881346 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f9b72c56-e820-4666-958a-93c6ca53d523 tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] Calling method '.version_select at 0x7f870bf94d30>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:11.947274 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-f9b72c56-e820-4666-958a-93c6ca53d523 tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/f0e7f330-9fa8-432b-adad-eb01bb8abde1" status: 200 len: 286 microversion: 2.1 time: 0.073135 Jul 31 18:37:11.947867 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 7/20] 10.222.0.49 () {58 vars in 1251 bytes} [Sun Jul 31 18:37:11 2022] GET /compute/v2.1/os-snapshots/f0e7f330-9fa8-432b-adad-eb01bb8abde1 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:37:11.987284 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-1f94bb1c-d7bd-4b45-b50e-b7de9cef1bef tempest-VolumesGetTestJSON-1367260828 tempest-VolumesGetTestJSON-1367260828-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/429ab2b7-c5ec-45c0-91c4-3c5e6f57d88f" status: 200 len: 353 microversion: 2.1 time: 0.143912 Jul 31 18:37:11.987861 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 14/21] 10.222.0.49 () {58 vars in 1245 bytes} [Sun Jul 31 18:37:11 2022] GET /compute/v2.1/os-volumes/429ab2b7-c5ec-45c0-91c4-3c5e6f57d88f => generated 353 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:37:12.960158 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-619b317b-84dd-4d81-b708-4a39c012de6f tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] Calling method '.version_select at 0x7f870bf94940>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:13.002064 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-af32abe7-aa66-48e8-80d6-018a1734d1a2 tempest-VolumesGetTestJSON-1367260828 tempest-VolumesGetTestJSON-1367260828-project] Calling method '.version_select at 0x7f870bf64280>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:13.008542 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-619b317b-84dd-4d81-b708-4a39c012de6f tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/f0e7f330-9fa8-432b-adad-eb01bb8abde1" status: 200 len: 286 microversion: 2.1 time: 0.052916 Jul 31 18:37:13.009785 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 8/22] 10.222.0.49 () {58 vars in 1251 bytes} [Sun Jul 31 18:37:12 2022] GET /compute/v2.1/os-snapshots/f0e7f330-9fa8-432b-adad-eb01bb8abde1 => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:37:13.368103 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-af32abe7-aa66-48e8-80d6-018a1734d1a2 tempest-VolumesGetTestJSON-1367260828 tempest-VolumesGetTestJSON-1367260828-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/429ab2b7-c5ec-45c0-91c4-3c5e6f57d88f" status: 200 len: 353 microversion: 2.1 time: 0.370204 Jul 31 18:37:13.384804 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 15/23] 10.222.0.49 () {58 vars in 1245 bytes} [Sun Jul 31 18:37:12 2022] GET /compute/v2.1/os-volumes/429ab2b7-c5ec-45c0-91c4-3c5e6f57d88f => generated 353 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:37:14.021750 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4dd146a4-e295-4810-8baf-fb08637677c0 tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] Calling method '.version_select at 0x7f870bf943a0>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:14.086951 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-4dd146a4-e295-4810-8baf-fb08637677c0 tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/f0e7f330-9fa8-432b-adad-eb01bb8abde1" status: 200 len: 286 microversion: 2.1 time: 0.069018 Jul 31 18:37:14.087522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 9/24] 10.222.0.49 () {58 vars in 1251 bytes} [Sun Jul 31 18:37:14 2022] GET /compute/v2.1/os-snapshots/f0e7f330-9fa8-432b-adad-eb01bb8abde1 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:37:14.391464 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-e7a105cd-b512-4797-98cb-343c28f00897 tempest-VolumesGetTestJSON-1367260828 tempest-VolumesGetTestJSON-1367260828-project] Calling method '.version_select at 0x7f870bf8e790>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:14.484354 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-e7a105cd-b512-4797-98cb-343c28f00897 tempest-VolumesGetTestJSON-1367260828 tempest-VolumesGetTestJSON-1367260828-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/429ab2b7-c5ec-45c0-91c4-3c5e6f57d88f" status: 200 len: 353 microversion: 2.1 time: 0.105124 Jul 31 18:37:14.491053 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 16/25] 10.222.0.49 () {58 vars in 1245 bytes} [Sun Jul 31 18:37:14 2022] GET /compute/v2.1/os-volumes/429ab2b7-c5ec-45c0-91c4-3c5e6f57d88f => generated 353 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:37:15.101071 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-8b48b40f-00cd-44f0-8acd-05cec8b8c644 tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] Calling method '.version_select at 0x7f870bf7c280>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:15.239097 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-8b48b40f-00cd-44f0-8acd-05cec8b8c644 tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/f0e7f330-9fa8-432b-adad-eb01bb8abde1" status: 200 len: 287 microversion: 2.1 time: 0.142499 Jul 31 18:37:15.240290 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 10/26] 10.222.0.49 () {58 vars in 1251 bytes} [Sun Jul 31 18:37:15 2022] GET /compute/v2.1/os-snapshots/f0e7f330-9fa8-432b-adad-eb01bb8abde1 => generated 287 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:37:15.254711 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-235056b8-806c-4543-a909-582d099365c0 tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] Calling method '.version_select at 0x7f870bf8e0d0>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:15.386736 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-235056b8-806c-4543-a909-582d099365c0 tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/f0e7f330-9fa8-432b-adad-eb01bb8abde1" status: 202 len: 0 microversion: 2.1 time: 0.139316 Jul 31 18:37:15.387877 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 17/27] 10.222.0.49 () {58 vars in 1254 bytes} [Sun Jul 31 18:37:15 2022] DELETE /compute/v2.1/os-snapshots/f0e7f330-9fa8-432b-adad-eb01bb8abde1 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:37:15.397423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-419739da-9cd1-48e3-9041-dba4b73725a6 tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] Calling method '.version_select at 0x7f870bf7caf0>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:15.476011 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-419739da-9cd1-48e3-9041-dba4b73725a6 tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/f0e7f330-9fa8-432b-adad-eb01bb8abde1" status: 200 len: 286 microversion: 2.1 time: 0.084018 Jul 31 18:37:15.476964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 11/28] 10.222.0.49 () {58 vars in 1251 bytes} [Sun Jul 31 18:37:15 2022] GET /compute/v2.1/os-snapshots/f0e7f330-9fa8-432b-adad-eb01bb8abde1 => generated 286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:37:15.499688 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-010f23f0-96f2-4525-be35-a89ff13dfd6e tempest-VolumesGetTestJSON-1367260828 tempest-VolumesGetTestJSON-1367260828-project] Calling method '.version_select at 0x7f870bf645e0>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:15.567618 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-010f23f0-96f2-4525-be35-a89ff13dfd6e tempest-VolumesGetTestJSON-1367260828 tempest-VolumesGetTestJSON-1367260828-project] HTTP exception thrown: Volume 429ab2b7-c5ec-45c0-91c4-3c5e6f57d88f could not be found. Jul 31 18:37:15.571722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-010f23f0-96f2-4525-be35-a89ff13dfd6e tempest-VolumesGetTestJSON-1367260828 tempest-VolumesGetTestJSON-1367260828-project] Request method failure captured: Jul 31 18:37:15.571722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: GET /compute/v2.1/os-volumes/429ab2b7-c5ec-45c0-91c4-3c5e6f57d88f HTTP/1.1 Jul 31 18:37:15.571722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:37:15.571722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:37:15.571722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:37:15.571722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:37:15.571722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:37:15.571722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:37:15.571722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:37:15.571722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:37:15.571722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5svU1U0Awbcq3qw_bYqaWjVxoiH81VmpP6WVARuTseKSi7AL_r_ERZMQ4xQe8syVOB5EucRNypcX9fX1q-GFRZooVi0lauBbtDHZmxIyV_r2M4NcomZh57HJca-ih5EVVTMpMlvlA-teW4xVY-ogmFAQm0O-UqqvMobLIbw4bVYL54A Jul 31 18:37:15.571722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:37:15.571722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:37:15.571722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:37:15.571722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:37:15.571722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:37:15.571722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:37:15.571722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: 5737a28d766849f8ab641c4594ed46f0 Jul 31 18:37:15.571722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-VolumesGetTestJSON-1367260828 Jul 31 18:37:15.571722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:37:15.571722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:37:15.572914 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5737a28d766849f8ab641c4594ed46f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5737a28d766849f8ab641c4594ed46f0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5737a28d766849f8ab641c4594ed46f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5737a28d766849f8ab641c4594ed46f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:37:15.572914 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-VolumesGetTestJSON-1367260828 Jul 31 18:37:15.572914 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: 5737a28d766849f8ab641c4594ed46f0 Jul 31 18:37:15.572914 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-VolumesGetTestJSON-1367260828 Jul 31 18:37:15.572914 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-VolumesGetTestJSON-1367260828-project Jul 31 18:37:15.572914 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:37:15.572914 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:37:15.572914 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 0b3e9aa34d474149a005ee8df63822fd Jul 31 18:37:15.572914 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-VolumesGetTestJSON-1367260828-project Jul 31 18:37:15.572914 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: Jul 31 18:37:15.572914 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Volume 429ab2b7-c5ec-45c0-91c4-3c5e6f57d88f could not be found. Jul 31 18:37:15.572914 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': '429ab2b7-c5ec-45c0-91c4-3c5e6f57d88f'} Jul 31 18:37:15.572914 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:37:15.573555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:15.573555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 18:37:15.573555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 18:37:15.573555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 18:37:15.573555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 18:37:15.573555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 18:37:15.573555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 18:37:15.573555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 18:37:15.573555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 18:37:15.573555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 18:37:15.573555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 18:37:15.573555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 18:37:15.573555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 18:37:15.573555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 18:37:15.573555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 18:37:15.573555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 429ab2b7-c5ec-45c0-91c4-3c5e6f57d88f could not be found. (HTTP 404) (Request-ID: req-abe9f4fb-6dbd-4f5a-9016-5d75e8adfec5) Jul 31 18:37:15.573555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:15.573555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:15.573555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:15.574383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:15.574383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 31 18:37:15.574383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 31 18:37:15.574383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 18:37:15.574383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 18:37:15.574383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 18:37:15.574383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 18:37:15.574383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 18:37:15.574383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 18:37:15.574383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 18:37:15.574383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 18:37:15.574383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 18:37:15.574383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 18:37:15.574383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 18:37:15.574383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 18:37:15.574383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 18:37:15.574383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 18:37:15.574383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 18:37:15.574383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 18:37:15.580271 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 18:37:15.580271 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 18:37:15.580271 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 18:37:15.580271 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 18:37:15.580271 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 429ab2b7-c5ec-45c0-91c4-3c5e6f57d88f could not be found. Jul 31 18:37:15.580271 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:15.580271 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:15.580271 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:15.580271 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:15.580271 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:37:15.580271 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:37:15.580271 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:37:15.580271 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:37:15.580271 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 18:37:15.580271 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 18:37:15.580271 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:37:15.580271 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:37:15.580271 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 31 18:37:15.580271 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:37:15.581226 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 429ab2b7-c5ec-45c0-91c4-3c5e6f57d88f could not be found. Jul 31 18:37:15.581226 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:15.581226 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:15.581226 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:15.581226 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:15.581226 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:37:15.581226 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:37:15.581226 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:37:15.581226 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:37:15.581226 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 429ab2b7-c5ec-45c0-91c4-3c5e6f57d88f could not be found. Jul 31 18:37:15.581226 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:37:15.581226 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-010f23f0-96f2-4525-be35-a89ff13dfd6e tempest-VolumesGetTestJSON-1367260828 tempest-VolumesGetTestJSON-1367260828-project] Returning 404 to user: Volume 429ab2b7-c5ec-45c0-91c4-3c5e6f57d88f could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:37:15.581226 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-010f23f0-96f2-4525-be35-a89ff13dfd6e tempest-VolumesGetTestJSON-1367260828 tempest-VolumesGetTestJSON-1367260828-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/429ab2b7-c5ec-45c0-91c4-3c5e6f57d88f" status: 404 len: 109 microversion: 2.1 time: 0.078926 Jul 31 18:37:15.581226 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 18/29] 10.222.0.49 () {58 vars in 1245 bytes} [Sun Jul 31 18:37:15 2022] GET /compute/v2.1/os-volumes/429ab2b7-c5ec-45c0-91c4-3c5e6f57d88f => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:37:16.490749 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-5aedb339-efb4-4dd3-ba21-22aa6d17324c tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] Calling method '.version_select at 0x7f870bf94040>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:16.544322 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-5aedb339-efb4-4dd3-ba21-22aa6d17324c tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] HTTP exception thrown: Snapshot f0e7f330-9fa8-432b-adad-eb01bb8abde1 could not be found. Jul 31 18:37:16.547937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-5aedb339-efb4-4dd3-ba21-22aa6d17324c tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] Request method failure captured: Jul 31 18:37:16.547937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: GET /compute/v2.1/os-snapshots/f0e7f330-9fa8-432b-adad-eb01bb8abde1 HTTP/1.1 Jul 31 18:37:16.547937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:37:16.547937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:37:16.547937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:37:16.547937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 0 Jul 31 18:37:16.547937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:37:16.547937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:37:16.547937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:37:16.547937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:37:16.547937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5svTwRGRrU5AZcRmeqG1CYHxAZ-SQKKsbEkxoyLdMaKhVZ_EJRLe8W7MLQAR3i9q-YQ8eSS_r-5c0Q-g6cvvlF2GlYCIpdh8c4slObxm5QiGgArs_Wh6JtGT1FxyBywM8ZdmbBuqf_anqp-L7RlwQbF2pdMi5juWvUhhwfIDZqBry_o Jul 31 18:37:16.547937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:37:16.547937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:37:16.547937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:37:16.547937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:37:16.547937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:37:16.547937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:37:16.547937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: c36ffef5602f4ffd806ae72e49d3b339 Jul 31 18:37:16.547937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-849952453 Jul 31 18:37:16.547937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:37:16.547937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:37:16.549267 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c36ffef5602f4ffd806ae72e49d3b339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c36ffef5602f4ffd806ae72e49d3b339", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c36ffef5602f4ffd806ae72e49d3b339"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c36ffef5602f4ffd806ae72e49d3b339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:37:16.549267 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-VolumesSnapshotsTestJSON-849952453 Jul 31 18:37:16.549267 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: c36ffef5602f4ffd806ae72e49d3b339 Jul 31 18:37:16.549267 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-849952453 Jul 31 18:37:16.549267 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-VolumesSnapshotsTestJSON-849952453-project Jul 31 18:37:16.549267 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:37:16.549267 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:37:16.549267 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: 3aaaec3395b04183926746825115ec62 Jul 31 18:37:16.549267 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-VolumesSnapshotsTestJSON-849952453-project Jul 31 18:37:16.549267 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: Jul 31 18:37:16.549267 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Snapshot f0e7f330-9fa8-432b-adad-eb01bb8abde1 could not be found. Jul 31 18:37:16.549267 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'id': 'f0e7f330-9fa8-432b-adad-eb01bb8abde1'} Jul 31 18:37:16.549267 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:37:16.549903 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:16.549903 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 31 18:37:16.549903 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 31 18:37:16.549903 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 31 18:37:16.549903 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 31 18:37:16.549903 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 31 18:37:16.549903 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 31 18:37:16.549903 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 18:37:16.549903 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 18:37:16.549903 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 18:37:16.549903 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 18:37:16.549903 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 18:37:16.549903 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 18:37:16.549903 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 18:37:16.549903 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 18:37:16.549903 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f0e7f330-9fa8-432b-adad-eb01bb8abde1 could not be found. (HTTP 404) (Request-ID: req-f6a88e1f-f293-4d83-92c7-bc2d762476cb) Jul 31 18:37:16.549903 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:16.549903 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:16.550738 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:16.550738 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:16.550738 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 31 18:37:16.550738 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 31 18:37:16.550738 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 18:37:16.550738 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 18:37:16.550738 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 31 18:37:16.550738 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 31 18:37:16.550738 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 18:37:16.550738 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 18:37:16.550738 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 31 18:37:16.550738 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 31 18:37:16.550738 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 31 18:37:16.550738 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 31 18:37:16.550738 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 31 18:37:16.550738 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 31 18:37:16.550738 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 18:37:16.550738 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 18:37:16.550738 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 18:37:16.551579 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 18:37:16.551579 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 18:37:16.551579 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 18:37:16.551579 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 18:37:16.551579 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 18:37:16.551579 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f0e7f330-9fa8-432b-adad-eb01bb8abde1 could not be found. Jul 31 18:37:16.551579 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:16.551579 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:16.551579 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:16.551579 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:16.551579 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:37:16.551579 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:37:16.551579 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:37:16.551579 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:37:16.551579 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 18:37:16.551579 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 18:37:16.551579 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:37:16.551579 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:37:16.551579 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 31 18:37:16.551579 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:37:16.552565 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f0e7f330-9fa8-432b-adad-eb01bb8abde1 could not be found. Jul 31 18:37:16.552565 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:16.552565 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:16.552565 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:16.552565 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:16.552565 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:37:16.552565 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:37:16.552565 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:37:16.552565 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:37:16.552565 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f0e7f330-9fa8-432b-adad-eb01bb8abde1 could not be found. Jul 31 18:37:16.552565 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:16.556088 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-5aedb339-efb4-4dd3-ba21-22aa6d17324c tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] Returning 404 to user: Snapshot f0e7f330-9fa8-432b-adad-eb01bb8abde1 could not be found. {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:37:16.558605 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-5aedb339-efb4-4dd3-ba21-22aa6d17324c tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/f0e7f330-9fa8-432b-adad-eb01bb8abde1" status: 404 len: 111 microversion: 2.1 time: 0.073686 Jul 31 18:37:16.561592 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 12/30] 10.222.0.49 () {58 vars in 1251 bytes} [Sun Jul 31 18:37:16 2022] GET /compute/v2.1/os-snapshots/f0e7f330-9fa8-432b-adad-eb01bb8abde1 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:37:16.570351 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-6a82cf62-19bb-41d9-ae2f-f66e24724170 tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] Calling method '.version_select at 0x7f870bf8ee50>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:16.697673 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-6a82cf62-19bb-41d9-ae2f-f66e24724170 tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/1136ec19-d8b1-4160-a490-3fc84e4641e4" status: 202 len: 0 microversion: 2.1 time: 0.131542 Jul 31 18:37:16.698239 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 19/31] 10.222.0.49 () {58 vars in 1248 bytes} [Sun Jul 31 18:37:16 2022] DELETE /compute/v2.1/os-volumes/1136ec19-d8b1-4160-a490-3fc84e4641e4 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 18:37:16.706910 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-c407938a-2299-46c6-ac26-edd6d3d4ef2b tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] Calling method '.version_select at 0x7f870c00c670>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:16.877863 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-c407938a-2299-46c6-ac26-edd6d3d4ef2b tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/1136ec19-d8b1-4160-a490-3fc84e4641e4" status: 200 len: 345 microversion: 2.1 time: 0.175053 Jul 31 18:37:16.878704 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 13/32] 10.222.0.49 () {58 vars in 1245 bytes} [Sun Jul 31 18:37:16 2022] GET /compute/v2.1/os-volumes/1136ec19-d8b1-4160-a490-3fc84e4641e4 => generated 345 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:37:17.893527 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-afd830f8-26c4-4567-a21a-c8fac7b3f3a8 tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] Calling method '.version_select at 0x7f870bf94dc0>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:18.023017 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-afd830f8-26c4-4567-a21a-c8fac7b3f3a8 tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] HTTP exception thrown: Volume 1136ec19-d8b1-4160-a490-3fc84e4641e4 could not be found. Jul 31 18:37:18.025966 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-afd830f8-26c4-4567-a21a-c8fac7b3f3a8 tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] Request method failure captured: Jul 31 18:37:18.025966 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: GET /compute/v2.1/os-volumes/1136ec19-d8b1-4160-a490-3fc84e4641e4 HTTP/1.1 Jul 31 18:37:18.025966 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:37:18.025966 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:37:18.025966 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:37:18.025966 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 0 Jul 31 18:37:18.025966 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:37:18.025966 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:37:18.025966 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:37:18.025966 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:37:18.025966 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5svTwRGRrU5AZcRmeqG1CYHxAZ-SQKKsbEkxoyLdMaKhVZ_EJRLe8W7MLQAR3i9q-YQ8eSS_r-5c0Q-g6cvvlF2GlYCIpdh8c4slObxm5QiGgArs_Wh6JtGT1FxyBywM8ZdmbBuqf_anqp-L7RlwQbF2pdMi5juWvUhhwfIDZqBry_o Jul 31 18:37:18.025966 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:37:18.025966 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:37:18.025966 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:37:18.025966 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:37:18.025966 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:37:18.025966 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:37:18.025966 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: c36ffef5602f4ffd806ae72e49d3b339 Jul 31 18:37:18.025966 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-849952453 Jul 31 18:37:18.025966 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:37:18.025966 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:37:18.027063 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c36ffef5602f4ffd806ae72e49d3b339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c36ffef5602f4ffd806ae72e49d3b339", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c36ffef5602f4ffd806ae72e49d3b339"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c36ffef5602f4ffd806ae72e49d3b339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:37:18.027063 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-VolumesSnapshotsTestJSON-849952453 Jul 31 18:37:18.027063 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: c36ffef5602f4ffd806ae72e49d3b339 Jul 31 18:37:18.027063 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-849952453 Jul 31 18:37:18.027063 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-VolumesSnapshotsTestJSON-849952453-project Jul 31 18:37:18.027063 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:37:18.027063 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:37:18.027063 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: 3aaaec3395b04183926746825115ec62 Jul 31 18:37:18.027063 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-VolumesSnapshotsTestJSON-849952453-project Jul 31 18:37:18.027063 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: Jul 31 18:37:18.027063 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Volume 1136ec19-d8b1-4160-a490-3fc84e4641e4 could not be found. Jul 31 18:37:18.027063 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'id': '1136ec19-d8b1-4160-a490-3fc84e4641e4'} Jul 31 18:37:18.027063 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:37:18.028508 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:18.028508 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 18:37:18.028508 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 18:37:18.028508 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 18:37:18.028508 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 18:37:18.028508 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 18:37:18.028508 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 18:37:18.028508 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 18:37:18.028508 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 18:37:18.028508 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 18:37:18.028508 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 18:37:18.028508 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 18:37:18.028508 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 18:37:18.028508 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 18:37:18.028508 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 18:37:18.028508 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1136ec19-d8b1-4160-a490-3fc84e4641e4 could not be found. (HTTP 404) (Request-ID: req-ddc10b8b-50f7-484d-8f45-910828afaafc) Jul 31 18:37:18.028508 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:18.028508 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:18.028508 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:18.030505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:18.030505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 31 18:37:18.030505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 31 18:37:18.030505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 18:37:18.030505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 18:37:18.030505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 18:37:18.030505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 18:37:18.030505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 18:37:18.030505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 18:37:18.030505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 18:37:18.030505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 18:37:18.030505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 18:37:18.030505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 18:37:18.030505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 18:37:18.030505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 18:37:18.030505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 18:37:18.030505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 18:37:18.030505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 18:37:18.030505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 18:37:18.034336 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 18:37:18.034336 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 18:37:18.034336 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 18:37:18.034336 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 18:37:18.034336 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1136ec19-d8b1-4160-a490-3fc84e4641e4 could not be found. Jul 31 18:37:18.034336 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:18.034336 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:18.034336 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:18.034336 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:18.034336 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:37:18.034336 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:37:18.034336 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:37:18.034336 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:37:18.034336 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 18:37:18.034336 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 18:37:18.034336 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:37:18.034336 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:37:18.034336 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 31 18:37:18.034336 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:37:18.037936 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1136ec19-d8b1-4160-a490-3fc84e4641e4 could not be found. Jul 31 18:37:18.037936 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:18.037936 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:18.037936 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:18.037936 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:18.037936 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:37:18.037936 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:37:18.037936 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:37:18.037936 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:37:18.037936 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1136ec19-d8b1-4160-a490-3fc84e4641e4 could not be found. Jul 31 18:37:18.037936 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:18.037936 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-afd830f8-26c4-4567-a21a-c8fac7b3f3a8 tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] Returning 404 to user: Volume 1136ec19-d8b1-4160-a490-3fc84e4641e4 could not be found. {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:37:18.037936 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-afd830f8-26c4-4567-a21a-c8fac7b3f3a8 tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/1136ec19-d8b1-4160-a490-3fc84e4641e4" status: 404 len: 109 microversion: 2.1 time: 0.137490 Jul 31 18:37:18.037936 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 14/33] 10.222.0.49 () {58 vars in 1245 bytes} [Sun Jul 31 18:37:17 2022] GET /compute/v2.1/os-volumes/1136ec19-d8b1-4160-a490-3fc84e4641e4 => generated 109 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:37:18.039772 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-7adadad7-e910-4f46-b44e-1f7d471421bb tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] Calling method '.version_select at 0x7f870bf8ca60>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:18.129269 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-7adadad7-e910-4f46-b44e-1f7d471421bb tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] HTTP exception thrown: Volume 1136ec19-d8b1-4160-a490-3fc84e4641e4 could not be found. Jul 31 18:37:18.131522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-7adadad7-e910-4f46-b44e-1f7d471421bb tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] Request method failure captured: Jul 31 18:37:18.131522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: DELETE /compute/v2.1/os-volumes/1136ec19-d8b1-4160-a490-3fc84e4641e4 HTTP/1.1 Jul 31 18:37:18.131522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:37:18.131522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:37:18.131522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:37:18.131522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 0 Jul 31 18:37:18.131522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:37:18.131522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:37:18.131522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:37:18.131522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:37:18.131522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5svTwRGRrU5AZcRmeqG1CYHxAZ-SQKKsbEkxoyLdMaKhVZ_EJRLe8W7MLQAR3i9q-YQ8eSS_r-5c0Q-g6cvvlF2GlYCIpdh8c4slObxm5QiGgArs_Wh6JtGT1FxyBywM8ZdmbBuqf_anqp-L7RlwQbF2pdMi5juWvUhhwfIDZqBry_o Jul 31 18:37:18.131522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:37:18.131522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:37:18.131522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:37:18.131522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:37:18.131522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:37:18.131522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:37:18.131522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: c36ffef5602f4ffd806ae72e49d3b339 Jul 31 18:37:18.131522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-849952453 Jul 31 18:37:18.131522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:37:18.131522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:37:18.133009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c36ffef5602f4ffd806ae72e49d3b339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c36ffef5602f4ffd806ae72e49d3b339", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c36ffef5602f4ffd806ae72e49d3b339"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c36ffef5602f4ffd806ae72e49d3b339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:37:18.133009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-VolumesSnapshotsTestJSON-849952453 Jul 31 18:37:18.133009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: c36ffef5602f4ffd806ae72e49d3b339 Jul 31 18:37:18.133009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-849952453 Jul 31 18:37:18.133009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-VolumesSnapshotsTestJSON-849952453-project Jul 31 18:37:18.133009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:37:18.133009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:37:18.133009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: 3aaaec3395b04183926746825115ec62 Jul 31 18:37:18.133009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-VolumesSnapshotsTestJSON-849952453-project Jul 31 18:37:18.133009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: Jul 31 18:37:18.133009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Volume 1136ec19-d8b1-4160-a490-3fc84e4641e4 could not be found. Jul 31 18:37:18.133009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'id': '1136ec19-d8b1-4160-a490-3fc84e4641e4'} Jul 31 18:37:18.133009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:37:18.134025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:18.134025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 18:37:18.134025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 18:37:18.134025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 31 18:37:18.134025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 31 18:37:18.134025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 31 18:37:18.134025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 31 18:37:18.134025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 31 18:37:18.134025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 31 18:37:18.134025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 31 18:37:18.134025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 31 18:37:18.134025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 18:37:18.134025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 18:37:18.134025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 18:37:18.134025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 18:37:18.134025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1136ec19-d8b1-4160-a490-3fc84e4641e4 could not be found. (HTTP 404) (Request-ID: req-2a24a97d-ce44-467d-8975-f37524d03fc5) Jul 31 18:37:18.134025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:18.134025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:18.134025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:18.135657 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:18.135657 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 31 18:37:18.135657 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 31 18:37:18.135657 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 18:37:18.135657 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 18:37:18.135657 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 18:37:18.135657 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 18:37:18.135657 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 18:37:18.135657 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 18:37:18.135657 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 18:37:18.135657 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 18:37:18.135657 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 31 18:37:18.135657 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 31 18:37:18.135657 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 31 18:37:18.135657 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 31 18:37:18.135657 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 31 18:37:18.135657 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 31 18:37:18.135657 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 31 18:37:18.135657 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 31 18:37:18.138991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 18:37:18.138991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 18:37:18.138991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 18:37:18.138991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 18:37:18.138991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1136ec19-d8b1-4160-a490-3fc84e4641e4 could not be found. Jul 31 18:37:18.138991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:18.138991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:18.138991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:18.138991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:18.138991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:37:18.138991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:37:18.138991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:37:18.138991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:37:18.138991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 18:37:18.138991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 18:37:18.138991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:37:18.138991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:37:18.138991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 31 18:37:18.138991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:37:18.141999 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1136ec19-d8b1-4160-a490-3fc84e4641e4 could not be found. Jul 31 18:37:18.141999 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:18.141999 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:18.141999 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:18.141999 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:18.141999 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:37:18.141999 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:37:18.141999 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:37:18.141999 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:37:18.141999 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1136ec19-d8b1-4160-a490-3fc84e4641e4 could not be found. Jul 31 18:37:18.141999 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:18.141999 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-7adadad7-e910-4f46-b44e-1f7d471421bb tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] Returning 404 to user: Volume 1136ec19-d8b1-4160-a490-3fc84e4641e4 could not be found. {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:37:18.141999 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-7adadad7-e910-4f46-b44e-1f7d471421bb tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/1136ec19-d8b1-4160-a490-3fc84e4641e4" status: 404 len: 109 microversion: 2.1 time: 0.099789 Jul 31 18:37:18.141999 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 15/34] 10.222.0.49 () {58 vars in 1248 bytes} [Sun Jul 31 18:37:18 2022] DELETE /compute/v2.1/os-volumes/1136ec19-d8b1-4160-a490-3fc84e4641e4 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:37:18.145018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-6b6a38b6-4586-44d6-b3f4-6d6f3ff8325b tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] Calling method '.version_select at 0x7f870bf94040>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:18.166418 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-cd4eacc0-fe4f-464a-9fcc-78f5ed274994 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-557482474", "imageRef": "6f2a0bb6-2fb3-4536-bee3-23e4e975f079", "flavorRef": "452", "networks": [{"uuid": "06e82437-2d1e-4ed2-b2b5-2ce7a33cffff"}]}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:37:18.186874 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-6b6a38b6-4586-44d6-b3f4-6d6f3ff8325b tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] HTTP exception thrown: Volume 1136ec19-d8b1-4160-a490-3fc84e4641e4 could not be found. Jul 31 18:37:18.188823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-6b6a38b6-4586-44d6-b3f4-6d6f3ff8325b tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] Request method failure captured: Jul 31 18:37:18.188823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: GET /compute/v2.1/os-volumes/1136ec19-d8b1-4160-a490-3fc84e4641e4 HTTP/1.1 Jul 31 18:37:18.188823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:37:18.188823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:37:18.188823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:37:18.188823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 0 Jul 31 18:37:18.188823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:37:18.188823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:37:18.188823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:37:18.188823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:37:18.188823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5svTwRGRrU5AZcRmeqG1CYHxAZ-SQKKsbEkxoyLdMaKhVZ_EJRLe8W7MLQAR3i9q-YQ8eSS_r-5c0Q-g6cvvlF2GlYCIpdh8c4slObxm5QiGgArs_Wh6JtGT1FxyBywM8ZdmbBuqf_anqp-L7RlwQbF2pdMi5juWvUhhwfIDZqBry_o Jul 31 18:37:18.188823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:37:18.188823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:37:18.188823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:37:18.188823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:37:18.188823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:37:18.188823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:37:18.188823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: c36ffef5602f4ffd806ae72e49d3b339 Jul 31 18:37:18.188823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-849952453 Jul 31 18:37:18.188823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:37:18.188823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:37:18.189884 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c36ffef5602f4ffd806ae72e49d3b339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c36ffef5602f4ffd806ae72e49d3b339", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c36ffef5602f4ffd806ae72e49d3b339"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c36ffef5602f4ffd806ae72e49d3b339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:37:18.189884 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-VolumesSnapshotsTestJSON-849952453 Jul 31 18:37:18.189884 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: c36ffef5602f4ffd806ae72e49d3b339 Jul 31 18:37:18.189884 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-849952453 Jul 31 18:37:18.189884 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-VolumesSnapshotsTestJSON-849952453-project Jul 31 18:37:18.189884 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:37:18.189884 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:37:18.189884 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: 3aaaec3395b04183926746825115ec62 Jul 31 18:37:18.189884 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-VolumesSnapshotsTestJSON-849952453-project Jul 31 18:37:18.189884 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: Jul 31 18:37:18.189884 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Volume 1136ec19-d8b1-4160-a490-3fc84e4641e4 could not be found. Jul 31 18:37:18.189884 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'id': '1136ec19-d8b1-4160-a490-3fc84e4641e4'} Jul 31 18:37:18.189884 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:37:18.190509 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:18.190509 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 18:37:18.190509 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 18:37:18.190509 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 18:37:18.190509 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 18:37:18.190509 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 18:37:18.190509 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 18:37:18.190509 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 18:37:18.190509 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 18:37:18.190509 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 18:37:18.190509 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 18:37:18.190509 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 18:37:18.190509 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 18:37:18.190509 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 18:37:18.190509 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 18:37:18.190509 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1136ec19-d8b1-4160-a490-3fc84e4641e4 could not be found. (HTTP 404) (Request-ID: req-6081edf5-d8f1-4e63-b8a7-ee41dac050bf) Jul 31 18:37:18.190509 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:18.190509 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:18.190509 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:18.192009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:18.192009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 31 18:37:18.192009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 31 18:37:18.192009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 18:37:18.192009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 18:37:18.192009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 18:37:18.192009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 18:37:18.192009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 18:37:18.192009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 18:37:18.192009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 18:37:18.192009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 18:37:18.192009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 18:37:18.192009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 18:37:18.192009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 18:37:18.192009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 18:37:18.192009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 18:37:18.192009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 18:37:18.192009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 18:37:18.192009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 18:37:18.193144 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 18:37:18.193144 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 18:37:18.193144 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 18:37:18.193144 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 18:37:18.193144 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1136ec19-d8b1-4160-a490-3fc84e4641e4 could not be found. Jul 31 18:37:18.193144 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:18.193144 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:18.193144 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:18.193144 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:18.193144 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:37:18.193144 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:37:18.193144 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:37:18.193144 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:37:18.193144 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 18:37:18.193144 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 18:37:18.193144 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:37:18.193144 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:37:18.193144 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 31 18:37:18.193144 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:37:18.195497 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1136ec19-d8b1-4160-a490-3fc84e4641e4 could not be found. Jul 31 18:37:18.195497 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:18.195497 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:37:18.195497 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:18.195497 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:37:18.195497 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:37:18.195497 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:37:18.195497 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:37:18.195497 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:37:18.195497 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1136ec19-d8b1-4160-a490-3fc84e4641e4 could not be found. Jul 31 18:37:18.195497 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:37:18.195497 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-6b6a38b6-4586-44d6-b3f4-6d6f3ff8325b tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] Returning 404 to user: Volume 1136ec19-d8b1-4160-a490-3fc84e4641e4 could not be found. {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:37:18.195497 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-6b6a38b6-4586-44d6-b3f4-6d6f3ff8325b tempest-VolumesSnapshotsTestJSON-849952453 tempest-VolumesSnapshotsTestJSON-849952453-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/1136ec19-d8b1-4160-a490-3fc84e4641e4" status: 404 len: 109 microversion: 2.1 time: 0.051305 Jul 31 18:37:18.195497 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 16/35] 10.222.0.49 () {58 vars in 1245 bytes} [Sun Jul 31 18:37:18 2022] GET /compute/v2.1/os-volumes/1136ec19-d8b1-4160-a490-3fc84e4641e4 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:37:18.359764 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.network.neutron [None req-cd4eacc0-fe4f-464a-9fcc-78f5ed274994 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] validate_networks() for [('06e82437-2d1e-4ed2-b2b5-2ce7a33cffff', None, None, None, None, None)] {{(pid=124333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 18:37:22.246726 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-cd4eacc0-fe4f-464a-9fcc-78f5ed274994 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Flavor limits 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 18:37:22.253062 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-cd4eacc0-fe4f-464a-9fcc-78f5ed274994 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Image limits 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 18:37:22.254248 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-cd4eacc0-fe4f-464a-9fcc-78f5ed274994 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Flavor pref 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 18:37:22.254851 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-cd4eacc0-fe4f-464a-9fcc-78f5ed274994 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Image pref 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 18:37:22.255864 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-cd4eacc0-fe4f-464a-9fcc-78f5ed274994 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 18:37:22.316407 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cd4eacc0-fe4f-464a-9fcc-78f5ed274994 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:22.327011 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cd4eacc0-fe4f-464a-9fcc-78f5ed274994 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:22.328052 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cd4eacc0-fe4f-464a-9fcc-78f5ed274994 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:22.328653 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cd4eacc0-fe4f-464a-9fcc-78f5ed274994 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:22.447859 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-cd4eacc0-fe4f-464a-9fcc-78f5ed274994 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Getting quotas for project a2eb8b8a120e4e87b4407d0abb3b3f07. Resources: {'cores', 'ram', 'instances'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:37:22.467886 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-cd4eacc0-fe4f-464a-9fcc-78f5ed274994 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Getting quotas for user e518e5691a7247de9d04ae9828809498 and project a2eb8b8a120e4e87b4407d0abb3b3f07. Resources: {'cores', 'ram', 'instances'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:37:22.526006 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-cd4eacc0-fe4f-464a-9fcc-78f5ed274994 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Going to run 1 instances... {{(pid=124333) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 18:37:22.545983 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-cd4eacc0-fe4f-464a-9fcc-78f5ed274994 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f2a0bb6-2fb3-4536-bee3-23e4e975f079',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 18:37:22.824436 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-cd4eacc0-fe4f-464a-9fcc-78f5ed274994 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.110637 Jul 31 18:37:22.825544 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 20/36] 10.222.0.49 () {60 vars in 1147 bytes} [Sun Jul 31 18:37:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 5112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 18:37:22.844552 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-5c2a0885-58a3-4f2e-bc98-b63adbc9fa1d tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:22.845402 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-5c2a0885-58a3-4f2e-bc98-b63adbc9fa1d tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:23.327120 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-5c2a0885-58a3-4f2e-bc98-b63adbc9fa1d tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e518e5691a7247de9d04ae9828809498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eb8b8a120e4e87b4407d0abb3b3f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:23.352200 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-5c2a0885-58a3-4f2e-bc98-b63adbc9fa1d tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 200 len: 1214 microversion: 2.1 time: 0.518636 Jul 31 18:37:23.354716 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 17/37] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:22 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 1214 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:24.241100 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-93b0fee2-36a8-4afc-a21a-33d6b1a1b2b5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Action: 'create', calling method: .version_select at 0x7f870be52ee0>, body: {"keypair": {"name": "tempest-keypair-1415744113", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuOKk2NUS6cTAdFuTKOaDLeIZuA9E955NrkP1YhtQkU14LZvZOIsXVZ4wZQCzDNNgpbn+HXXWntEBo0Le90WkZq8vJP53kHTsps7woy8eS6nfDhO/G6X+L2vVJhZYqzwA=="}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:37:24.284261 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-93b0fee2-36a8-4afc-a21a-33d6b1a1b2b5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Getting quotas for project 2269cace554c401a8b6a6303ff4e4da8. Resources: {'key_pairs'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:37:24.289423 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-93b0fee2-36a8-4afc-a21a-33d6b1a1b2b5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Getting quotas for user 120c06d6dee6425ea5366b363d5a5f7e and project 2269cace554c401a8b6a6303ff4e4da8. Resources: {'key_pairs'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:37:24.379454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-27ed0c10-3a87-45e6-9dd8-7010386f9f1d tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:24.381053 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-27ed0c10-3a87-45e6-9dd8-7010386f9f1d tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:24.382669 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-93b0fee2-36a8-4afc-a21a-33d6b1a1b2b5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.526508 Jul 31 18:37:24.383328 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 21/38] 10.222.0.49 () {62 vars in 1200 bytes} [Sun Jul 31 18:37:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 528 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 31 18:37:24.611836 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-bad686a5-1bc0-464b-9132-825ec7777d68 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Action: 'create', calling method: .version_select at 0x7f870be52c10>, body: {"keypair": {"name": "tempest-keypair-1306665566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVU8L0hTVFoo3sXL8a90yjk12JJYfObnZHOZju1c/J90X0Ir8S89fs5QszuQisTgw7Lg0pR23lLyaHTzB/gTp8JdyutX+NT2hIqqgwVOpeT8/QGwHthB2fO3OT2Rb+Wug=="}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:37:24.658586 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-bad686a5-1bc0-464b-9132-825ec7777d68 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Getting quotas for project fc4113d291354d99b2591289639ec248. Resources: {'key_pairs'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:37:24.663701 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-bad686a5-1bc0-464b-9132-825ec7777d68 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Getting quotas for user 4dc88d9b0bc743119dcb7dc2fa8fdcd6 and project fc4113d291354d99b2591289639ec248. Resources: {'key_pairs'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:37:24.751782 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-bad686a5-1bc0-464b-9132-825ec7777d68 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.235793 Jul 31 18:37:24.761094 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 22/39] 10.222.0.49 () {60 vars in 1159 bytes} [Sun Jul 31 18:37:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:37:24.831176 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-27ed0c10-3a87-45e6-9dd8-7010386f9f1d tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e518e5691a7247de9d04ae9828809498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eb8b8a120e4e87b4407d0abb3b3f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:24.841472 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-27ed0c10-3a87-45e6-9dd8-7010386f9f1d tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 200 len: 1214 microversion: 2.1 time: 0.467984 Jul 31 18:37:24.843746 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 18/40] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:24 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 1214 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:25.864159 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-5878faf0-a278-4bed-89c2-90cc1bd99efd tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:25.865546 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-5878faf0-a278-4bed-89c2-90cc1bd99efd tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:25.924174 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5878faf0-a278-4bed-89c2-90cc1bd99efd tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:25.924865 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5878faf0-a278-4bed-89c2-90cc1bd99efd tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:25.926460 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5878faf0-a278-4bed-89c2-90cc1bd99efd tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:25.930519 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5878faf0-a278-4bed-89c2-90cc1bd99efd tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:26.004247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-65532160-242d-4348-a717-8a471577be13 tempest-VolumesTestJSON-395641909 tempest-VolumesTestJSON-395641909-project] Calling method '.version_select at 0x7f870bf2d550>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:26.115242 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-65532160-242d-4348-a717-8a471577be13 tempest-VolumesTestJSON-395641909 tempest-VolumesTestJSON-395641909-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/4f22409a-d705-494f-9589-0ef201ce6781" status: 200 len: 351 microversion: 2.1 time: 0.122778 Jul 31 18:37:26.121589 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 19/41] 10.222.0.49 () {58 vars in 1245 bytes} [Sun Jul 31 18:37:25 2022] GET /compute/v2.1/os-volumes/4f22409a-d705-494f-9589-0ef201ce6781 => generated 351 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:37:26.646854 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-5878faf0-a278-4bed-89c2-90cc1bd99efd tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e518e5691a7247de9d04ae9828809498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eb8b8a120e4e87b4407d0abb3b3f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:26.679552 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-5878faf0-a278-4bed-89c2-90cc1bd99efd tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 200 len: 1210 microversion: 2.1 time: 0.819645 Jul 31 18:37:26.685533 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 23/42] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:25 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 1210 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:27.706575 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-cf00e591-11ee-40c9-b5ee-bd4689cd7ae6 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:27.707213 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-cf00e591-11ee-40c9-b5ee-bd4689cd7ae6 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:27.718303 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cf00e591-11ee-40c9-b5ee-bd4689cd7ae6 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:27.718809 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cf00e591-11ee-40c9-b5ee-bd4689cd7ae6 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:27.719560 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cf00e591-11ee-40c9-b5ee-bd4689cd7ae6 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:27.720024 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cf00e591-11ee-40c9-b5ee-bd4689cd7ae6 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:27.837155 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-60e355ed-1d83-40eb-ac9d-be61869e38a3 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Action: 'create', calling method: .version_select at 0x7f870bf2d940>, body: {"keypair": {"name": "tempest-keypair-1383514151", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcpLHZdfrlPzt7Tmnckp7FnDudc8eYKv17TQd5kQZpqNCEwSrCMOsioaQSWzZg93Hay9xlbWfiNr/HckYyC/vEu0WCn5uEUNwgPGr0mfLpWiBll5Luu2f2cBXHrAidA7Q=="}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:37:27.892730 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.quota [None req-60e355ed-1d83-40eb-ac9d-be61869e38a3 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Getting quotas for project 8b2df629457c4ff68ad061eb29cb232f. Resources: {'key_pairs'} {{(pid=124334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:37:27.902643 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.quota [None req-60e355ed-1d83-40eb-ac9d-be61869e38a3 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Getting quotas for user 88472fa130654657af599106c6aac279 and project 8b2df629457c4ff68ad061eb29cb232f. Resources: {'key_pairs'} {{(pid=124334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:37:27.998599 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-60e355ed-1d83-40eb-ac9d-be61869e38a3 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.418302 Jul 31 18:37:28.000844 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 20/43] 10.222.0.49 () {60 vars in 1159 bytes} [Sun Jul 31 18:37:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:37:28.056687 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-6fd6b0a6-e1e1-4872-885e-20a75c918d10 tempest-VolumesTestJSON-395641909 tempest-VolumesTestJSON-395641909-project] Calling method '.version_select at 0x7f870bf8c040>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:28.214371 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-6fd6b0a6-e1e1-4872-885e-20a75c918d10 tempest-VolumesTestJSON-395641909 tempest-VolumesTestJSON-395641909-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/19958d39-6500-4c67-ae56-3f7ec4b43edf" status: 200 len: 351 microversion: 2.1 time: 0.163296 Jul 31 18:37:28.214974 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 21/44] 10.222.0.49 () {58 vars in 1245 bytes} [Sun Jul 31 18:37:28 2022] GET /compute/v2.1/os-volumes/19958d39-6500-4c67-ae56-3f7ec4b43edf => generated 351 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:37:28.592711 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-cf00e591-11ee-40c9-b5ee-bd4689cd7ae6 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e518e5691a7247de9d04ae9828809498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eb8b8a120e4e87b4407d0abb3b3f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:28.608287 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-cf00e591-11ee-40c9-b5ee-bd4689cd7ae6 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 200 len: 1272 microversion: 2.1 time: 0.904728 Jul 31 18:37:28.611549 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 24/45] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:27 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 1272 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:29.637804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-d6d0b2a6-38b7-4376-b799-53ddaf1705e4 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:29.639258 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-d6d0b2a6-38b7-4376-b799-53ddaf1705e4 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:29.649771 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d6d0b2a6-38b7-4376-b799-53ddaf1705e4 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:29.653249 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d6d0b2a6-38b7-4376-b799-53ddaf1705e4 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:29.654314 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d6d0b2a6-38b7-4376-b799-53ddaf1705e4 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:29.656575 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d6d0b2a6-38b7-4376-b799-53ddaf1705e4 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:30.825370 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-43436ddb-df3c-42d5-b276-f8b558bb8760 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1018494574", "imageRef": "6f2a0bb6-2fb3-4536-bee3-23e4e975f079", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:37:30.940883 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.network.neutron [None req-43436ddb-df3c-42d5-b276-f8b558bb8760 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] validate_networks() for [('ff0682ec-31f5-4445-9595-fd7388d7f61d', None, None, None, None, None)] {{(pid=124333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 18:37:31.139226 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-d6d0b2a6-38b7-4376-b799-53ddaf1705e4 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e518e5691a7247de9d04ae9828809498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eb8b8a120e4e87b4407d0abb3b3f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:31.170963 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-d6d0b2a6-38b7-4376-b799-53ddaf1705e4 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 200 len: 1314 microversion: 2.1 time: 1.529104 Jul 31 18:37:31.218279 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 22/46] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:29 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 1314 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:32.202204 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-9c1db69f-6b84-4f75-beb9-c762ef937e12 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:32.202863 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-9c1db69f-6b84-4f75-beb9-c762ef937e12 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:32.210297 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9c1db69f-6b84-4f75-beb9-c762ef937e12 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:32.210812 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9c1db69f-6b84-4f75-beb9-c762ef937e12 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:32.211707 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9c1db69f-6b84-4f75-beb9-c762ef937e12 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:32.212144 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9c1db69f-6b84-4f75-beb9-c762ef937e12 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:32.396364 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell0:SELECT=2 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:32.697535 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-9c1db69f-6b84-4f75-beb9-c762ef937e12 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e518e5691a7247de9d04ae9828809498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eb8b8a120e4e87b4407d0abb3b3f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:32.713729 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-9c1db69f-6b84-4f75-beb9-c762ef937e12 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 200 len: 1314 microversion: 2.1 time: 0.515661 Jul 31 18:37:32.727682 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 23/47] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:32 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:32.743346 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-283d53d7-ee7d-4a22-9d83-8e5097e0e1bb tempest-VolumesTestJSON-395641909 tempest-VolumesTestJSON-395641909-project] Calling method '.version_select at 0x7f870be8ac10>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:32.849356 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-283d53d7-ee7d-4a22-9d83-8e5097e0e1bb tempest-VolumesTestJSON-395641909 tempest-VolumesTestJSON-395641909-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/a7d53c8b-efac-4b5f-86ae-250f4edf65ec" status: 200 len: 351 microversion: 2.1 time: 0.120061 Jul 31 18:37:32.850479 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 24/48] 10.222.0.49 () {58 vars in 1245 bytes} [Sun Jul 31 18:37:32 2022] GET /compute/v2.1/os-volumes/a7d53c8b-efac-4b5f-86ae-250f4edf65ec => generated 351 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:37:32.863691 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-0966b65e-57bd-4353-b1f4-cb066abfdd3c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-491049825", "imageRef": "6f2a0bb6-2fb3-4536-bee3-23e4e975f079", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3dc6b6b8-baff-4122-86db-debe82c87f7f"}], "security_groups": [{"name": "tempest-securitygroup--1147723197"}], "key_name": "tempest-keypair-1415744113", "user_data": "}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:37:33.483431 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.network.neutron [None req-0966b65e-57bd-4353-b1f4-cb066abfdd3c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] validate_networks() for [('3dc6b6b8-baff-4122-86db-debe82c87f7f', None, None, None, None, None)] {{(pid=124334) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 18:37:33.919443 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-43436ddb-df3c-42d5-b276-f8b558bb8760 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Flavor limits 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 18:37:33.921205 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-43436ddb-df3c-42d5-b276-f8b558bb8760 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Image limits 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 18:37:33.921990 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-43436ddb-df3c-42d5-b276-f8b558bb8760 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Flavor pref 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 18:37:33.922590 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-43436ddb-df3c-42d5-b276-f8b558bb8760 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Image pref 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 18:37:33.923198 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-43436ddb-df3c-42d5-b276-f8b558bb8760 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 18:37:33.943332 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-43436ddb-df3c-42d5-b276-f8b558bb8760 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:33.945138 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-43436ddb-df3c-42d5-b276-f8b558bb8760 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:33.945138 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-43436ddb-df3c-42d5-b276-f8b558bb8760 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:33.949975 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-43436ddb-df3c-42d5-b276-f8b558bb8760 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:33.988312 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-43436ddb-df3c-42d5-b276-f8b558bb8760 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Getting quotas for project df42ccb208664e04ac753b0c64b4fab7. Resources: {'cores', 'ram', 'instances'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:37:33.993795 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-43436ddb-df3c-42d5-b276-f8b558bb8760 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Getting quotas for user 0d7ed577305d48c795f280e49b438bfc and project df42ccb208664e04ac753b0c64b4fab7. Resources: {'cores', 'ram', 'instances'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:37:34.008921 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-43436ddb-df3c-42d5-b276-f8b558bb8760 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Going to run 1 instances... {{(pid=124333) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 18:37:34.011487 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-43436ddb-df3c-42d5-b276-f8b558bb8760 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f2a0bb6-2fb3-4536-bee3-23e4e975f079',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 18:37:34.136090 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-43436ddb-df3c-42d5-b276-f8b558bb8760 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.535133 Jul 31 18:37:34.155620 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 25/49] 10.222.0.49 () {60 vars in 1147 bytes} [Sun Jul 31 18:37:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 3555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 18:37:34.184256 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-9d64495b-6e2d-4571-86ad-bc97764d194c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-781691024", "imageRef": "6f2a0bb6-2fb3-4536-bee3-23e4e975f079", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5aeb6c21-a6d3-4ca0-97dc-7cf6239b2c5d"}], "security_groups": [{"name": "tempest-securitygroup--1920765044"}], "key_name": "tempest-keypair-1306665566", "user_data": "}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:37:34.818811 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.network.neutron [None req-9d64495b-6e2d-4571-86ad-bc97764d194c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] validate_networks() for [('5aeb6c21-a6d3-4ca0-97dc-7cf6239b2c5d', None, None, None, None, None)] {{(pid=124333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 18:37:35.187295 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-0966b65e-57bd-4353-b1f4-cb066abfdd3c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Flavor limits 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 18:37:35.189098 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-0966b65e-57bd-4353-b1f4-cb066abfdd3c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Image limits 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 18:37:35.189098 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-0966b65e-57bd-4353-b1f4-cb066abfdd3c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Flavor pref 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 18:37:35.189098 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-0966b65e-57bd-4353-b1f4-cb066abfdd3c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Image pref 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 18:37:35.189319 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-0966b65e-57bd-4353-b1f4-cb066abfdd3c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 18:37:35.222229 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0966b65e-57bd-4353-b1f4-cb066abfdd3c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:35.222769 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0966b65e-57bd-4353-b1f4-cb066abfdd3c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:35.223651 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0966b65e-57bd-4353-b1f4-cb066abfdd3c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:35.224091 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0966b65e-57bd-4353-b1f4-cb066abfdd3c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:35.362148 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.quota [None req-0966b65e-57bd-4353-b1f4-cb066abfdd3c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Getting quotas for project 2269cace554c401a8b6a6303ff4e4da8. Resources: {'cores', 'ram', 'instances'} {{(pid=124334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:37:35.392578 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.quota [None req-0966b65e-57bd-4353-b1f4-cb066abfdd3c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Getting quotas for user 120c06d6dee6425ea5366b363d5a5f7e and project 2269cace554c401a8b6a6303ff4e4da8. Resources: {'cores', 'ram', 'instances'} {{(pid=124334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:37:35.450583 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-0966b65e-57bd-4353-b1f4-cb066abfdd3c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Going to run 1 instances... {{(pid=124334) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 18:37:35.459926 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-0966b65e-57bd-4353-b1f4-cb066abfdd3c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f2a0bb6-2fb3-4536-bee3-23e4e975f079',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 18:37:35.637665 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-0966b65e-57bd-4353-b1f4-cb066abfdd3c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.785718 Jul 31 18:37:35.639549 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 25/50] 10.222.0.49 () {62 vars in 1188 bytes} [Sun Jul 31 18:37:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 2788 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 31 18:37:35.649796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-5a4db150-0353-42df-af9a-6800e5eed042 tempest-VolumesTestJSON-395641909 tempest-VolumesTestJSON-395641909-project] Calling method '.version_select at 0x7f870b522040>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:35.926463 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-5a4db150-0353-42df-af9a-6800e5eed042 tempest-VolumesTestJSON-395641909 tempest-VolumesTestJSON-395641909-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.285206 Jul 31 18:37:35.927152 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 26/51] 10.222.0.49 () {58 vars in 1134 bytes} [Sun Jul 31 18:37:35 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:35.940854 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-3b61bdb7-2135-4a2c-b369-7ef81a693b28 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:35.941468 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-3b61bdb7-2135-4a2c-b369-7ef81a693b28 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:35.967105 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3b61bdb7-2135-4a2c-b369-7ef81a693b28 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:35.971713 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3b61bdb7-2135-4a2c-b369-7ef81a693b28 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:35.972521 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3b61bdb7-2135-4a2c-b369-7ef81a693b28 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:35.976916 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3b61bdb7-2135-4a2c-b369-7ef81a693b28 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:36.944313 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-9d64495b-6e2d-4571-86ad-bc97764d194c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Flavor limits 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 18:37:36.945057 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-9d64495b-6e2d-4571-86ad-bc97764d194c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Image limits 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 18:37:36.945638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-9d64495b-6e2d-4571-86ad-bc97764d194c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Flavor pref 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 18:37:36.946149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-9d64495b-6e2d-4571-86ad-bc97764d194c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Image pref 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 18:37:36.946664 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-9d64495b-6e2d-4571-86ad-bc97764d194c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 18:37:36.965310 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9d64495b-6e2d-4571-86ad-bc97764d194c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:36.966288 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9d64495b-6e2d-4571-86ad-bc97764d194c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:36.969404 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9d64495b-6e2d-4571-86ad-bc97764d194c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:36.970621 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9d64495b-6e2d-4571-86ad-bc97764d194c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:37.029557 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-9d64495b-6e2d-4571-86ad-bc97764d194c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Getting quotas for project fc4113d291354d99b2591289639ec248. Resources: {'cores', 'ram', 'instances'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:37:37.044892 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-9d64495b-6e2d-4571-86ad-bc97764d194c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Getting quotas for user 4dc88d9b0bc743119dcb7dc2fa8fdcd6 and project fc4113d291354d99b2591289639ec248. Resources: {'cores', 'ram', 'instances'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:37:37.050645 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-3b61bdb7-2135-4a2c-b369-7ef81a693b28 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e518e5691a7247de9d04ae9828809498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eb8b8a120e4e87b4407d0abb3b3f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:37.061426 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-3b61bdb7-2135-4a2c-b369-7ef81a693b28 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 200 len: 1314 microversion: 2.1 time: 1.130524 Jul 31 18:37:37.066753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-9d64495b-6e2d-4571-86ad-bc97764d194c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Going to run 1 instances... {{(pid=124333) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 18:37:37.068141 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 27/52] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:35 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 1314 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:37.069490 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-9d64495b-6e2d-4571-86ad-bc97764d194c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f2a0bb6-2fb3-4536-bee3-23e4e975f079',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 18:37:37.091774 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-aaf5b327-2d51-4c68-9323-2de006aa5c63 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:37.101048 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-aaf5b327-2d51-4c68-9323-2de006aa5c63 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:37.129484 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-aaf5b327-2d51-4c68-9323-2de006aa5c63 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:37.139493 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-aaf5b327-2d51-4c68-9323-2de006aa5c63 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:37.140604 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-aaf5b327-2d51-4c68-9323-2de006aa5c63 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:37.141232 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-aaf5b327-2d51-4c68-9323-2de006aa5c63 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:37.158231 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-9d64495b-6e2d-4571-86ad-bc97764d194c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.000250 Jul 31 18:37:37.159649 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 26/53] 10.222.0.49 () {60 vars in 1147 bytes} [Sun Jul 31 18:37:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 3003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 18:37:37.170284 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-3aa593fa-d4c1-42be-8c6a-21601508fb89 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:37.171257 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-3aa593fa-d4c1-42be-8c6a-21601508fb89 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:37.181786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3aa593fa-d4c1-42be-8c6a-21601508fb89 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:37.183226 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3aa593fa-d4c1-42be-8c6a-21601508fb89 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:37.184263 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3aa593fa-d4c1-42be-8c6a-21601508fb89 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:37.185511 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3aa593fa-d4c1-42be-8c6a-21601508fb89 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:37.397080 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-3aa593fa-d4c1-42be-8c6a-21601508fb89 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:37.406715 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-3aa593fa-d4c1-42be-8c6a-21601508fb89 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:37.412218 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-3aa593fa-d4c1-42be-8c6a-21601508fb89 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:37.420639 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-3aa593fa-d4c1-42be-8c6a-21601508fb89 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1285 microversion: 2.20 time: 0.256501 Jul 31 18:37:37.425099 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 27/54] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:37:37 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1285 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:37:37.452670 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-aaf5b327-2d51-4c68-9323-2de006aa5c63 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:37.459410 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-cde23f1b-3522-4bf3-b92b-bef50b49c7bb tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1539627869", "imageRef": "6f2a0bb6-2fb3-4536-bee3-23e4e975f079", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf14a566-5800-492e-9819-b36a005e1f98"}], "security_groups": [{"name": "tempest-securitygroup--841585344"}], "key_name": "tempest-keypair-1383514151", "user_data": "}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:37:37.483008 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-aaf5b327-2d51-4c68-9323-2de006aa5c63 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1226 microversion: 2.1 time: 0.411535 Jul 31 18:37:37.487718 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 28/55] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:37 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1226 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:37.534734 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4a65d5e2-ea81-4036-a2ce-4f4d3208749a tempest-VolumesTestJSON-395641909 tempest-VolumesTestJSON-395641909-project] Calling method '.version_select at 0x7f870b522a60>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:37.938662 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-4a65d5e2-ea81-4036-a2ce-4f4d3208749a tempest-VolumesTestJSON-395641909 tempest-VolumesTestJSON-395641909-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.449018 Jul 31 18:37:37.944819 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 29/56] 10.222.0.49 () {58 vars in 1149 bytes} [Sun Jul 31 18:37:37 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:37:38.061001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.network.neutron [None req-cde23f1b-3522-4bf3-b92b-bef50b49c7bb tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] validate_networks() for [('cf14a566-5800-492e-9819-b36a005e1f98', None, None, None, None, None)] {{(pid=124333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 18:37:38.099730 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-777fd89d-9d7e-4bfa-bef8-33b59b066fc2 req-ca5c9911-1f2c-441a-be5b-1987ed4049dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3c5c619-b8b1-4c29-b8a1-e7427f571386", "tag": "c9421a90-d6c6-4c5a-8004-5b32536878d2"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:37:38.139968 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-777fd89d-9d7e-4bfa-bef8-33b59b066fc2 req-ca5c9911-1f2c-441a-be5b-1987ed4049dc service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:38.143782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-777fd89d-9d7e-4bfa-bef8-33b59b066fc2 req-ca5c9911-1f2c-441a-be5b-1987ed4049dc service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:38.218805 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-777fd89d-9d7e-4bfa-bef8-33b59b066fc2 req-ca5c9911-1f2c-441a-be5b-1987ed4049dc service nova] Creating event network-changed:c9421a90-d6c6-4c5a-8004-5b32536878d2 for instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 on hv-cinder-84984 Jul 31 18:37:38.221330 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-777fd89d-9d7e-4bfa-bef8-33b59b066fc2 req-ca5c9911-1f2c-441a-be5b-1987ed4049dc service nova] Acquired lock "compute-rpcapi-router" {{(pid=124334) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 31 18:37:38.225118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-407b2823-5953-42da-bfb7-21e77a52786e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:38.229423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-407b2823-5953-42da-bfb7-21e77a52786e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:38.230630 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-407b2823-5953-42da-bfb7-21e77a52786e None None] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:38.231231 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-407b2823-5953-42da-bfb7-21e77a52786e None None] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:38.257449 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.compute.rpcapi [None req-407b2823-5953-42da-bfb7-21e77a52786e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 31 18:37:38.259182 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-407b2823-5953-42da-bfb7-21e77a52786e None None] Releasing lock "compute-rpcapi-router" {{(pid=124334) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 31 18:37:38.293877 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-407b2823-5953-42da-bfb7-21e77a52786e None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.347481 Jul 31 18:37:38.295798 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 30/57] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:37:38.307745 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-67b910f4-f8c4-4581-8407-b7fb1c3a21c6 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:38.309560 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-67b910f4-f8c4-4581-8407-b7fb1c3a21c6 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:38.528617 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-67b910f4-f8c4-4581-8407-b7fb1c3a21c6 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:38.538094 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-67b910f4-f8c4-4581-8407-b7fb1c3a21c6 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1237 microversion: 2.1 time: 0.239927 Jul 31 18:37:38.538094 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 31/58] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:38 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1237 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:38.558928 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-7ce525b8-948f-4d99-95fb-8d93dc96ce1d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1260132133", "imageRef": "6f2a0bb6-2fb3-4536-bee3-23e4e975f079", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:37:38.719452 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.network.neutron [None req-7ce525b8-948f-4d99-95fb-8d93dc96ce1d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] validate_networks() for [('ff0682ec-31f5-4445-9595-fd7388d7f61d', None, None, None, None, None)] {{(pid=124334) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 18:37:39.223308 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-cde23f1b-3522-4bf3-b92b-bef50b49c7bb tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Flavor limits 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 18:37:39.224344 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-cde23f1b-3522-4bf3-b92b-bef50b49c7bb tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Image limits 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 18:37:39.225030 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-cde23f1b-3522-4bf3-b92b-bef50b49c7bb tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Flavor pref 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 18:37:39.225602 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-cde23f1b-3522-4bf3-b92b-bef50b49c7bb tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Image pref 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 18:37:39.226154 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-cde23f1b-3522-4bf3-b92b-bef50b49c7bb tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 18:37:39.242874 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cde23f1b-3522-4bf3-b92b-bef50b49c7bb tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:39.243330 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cde23f1b-3522-4bf3-b92b-bef50b49c7bb tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:39.244126 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cde23f1b-3522-4bf3-b92b-bef50b49c7bb tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:39.244572 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cde23f1b-3522-4bf3-b92b-bef50b49c7bb tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:39.293896 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-cde23f1b-3522-4bf3-b92b-bef50b49c7bb tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Getting quotas for project 8b2df629457c4ff68ad061eb29cb232f. Resources: {'cores', 'ram', 'instances'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:37:39.311280 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-cde23f1b-3522-4bf3-b92b-bef50b49c7bb tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Getting quotas for user 88472fa130654657af599106c6aac279 and project 8b2df629457c4ff68ad061eb29cb232f. Resources: {'cores', 'ram', 'instances'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:37:39.333842 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-cde23f1b-3522-4bf3-b92b-bef50b49c7bb tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Going to run 1 instances... {{(pid=124333) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 18:37:39.340958 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-cde23f1b-3522-4bf3-b92b-bef50b49c7bb tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f2a0bb6-2fb3-4536-bee3-23e4e975f079',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 18:37:39.414477 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-cde23f1b-3522-4bf3-b92b-bef50b49c7bb tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.974162 Jul 31 18:37:39.415474 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 28/59] 10.222.0.49 () {60 vars in 1147 bytes} [Sun Jul 31 18:37:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 1989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 18:37:39.420482 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-bf354cf4-27fd-49b8-b027-9d5ffa8763e3 tempest-VolumesTestJSON-395641909 tempest-VolumesTestJSON-395641909-project] Calling method '.version_select at 0x7f870a520c10>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:39.795502 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-bf354cf4-27fd-49b8-b027-9d5ffa8763e3 tempest-VolumesTestJSON-395641909 tempest-VolumesTestJSON-395641909-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.378539 Jul 31 18:37:39.795953 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 29/60] 10.222.0.49 () {58 vars in 1134 bytes} [Sun Jul 31 18:37:39 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:39.803832 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-b7ede0da-8031-4ecf-ac9b-413e687a1ad3 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:39.803832 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-b7ede0da-8031-4ecf-ac9b-413e687a1ad3 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:39.816433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=14 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:39.819730 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b7ede0da-8031-4ecf-ac9b-413e687a1ad3 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:39.820185 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b7ede0da-8031-4ecf-ac9b-413e687a1ad3 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:39.824847 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b7ede0da-8031-4ecf-ac9b-413e687a1ad3 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:39.833512 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b7ede0da-8031-4ecf-ac9b-413e687a1ad3 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:40.577749 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-7ce525b8-948f-4d99-95fb-8d93dc96ce1d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Flavor limits 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 18:37:40.579206 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-7ce525b8-948f-4d99-95fb-8d93dc96ce1d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Image limits 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 18:37:40.579999 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-7ce525b8-948f-4d99-95fb-8d93dc96ce1d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Flavor pref 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 18:37:40.580729 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-7ce525b8-948f-4d99-95fb-8d93dc96ce1d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Image pref 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 18:37:40.581568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-7ce525b8-948f-4d99-95fb-8d93dc96ce1d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 18:37:40.599577 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7ce525b8-948f-4d99-95fb-8d93dc96ce1d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:40.600420 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7ce525b8-948f-4d99-95fb-8d93dc96ce1d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:40.602201 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7ce525b8-948f-4d99-95fb-8d93dc96ce1d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:40.602867 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7ce525b8-948f-4d99-95fb-8d93dc96ce1d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:40.613590 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-b7ede0da-8031-4ecf-ac9b-413e687a1ad3 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e518e5691a7247de9d04ae9828809498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eb8b8a120e4e87b4407d0abb3b3f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:40.623702 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-b7ede0da-8031-4ecf-ac9b-413e687a1ad3 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 200 len: 1314 microversion: 2.1 time: 0.826690 Jul 31 18:37:40.630435 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 30/61] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:39 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 1314 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:40.633496 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.quota [None req-7ce525b8-948f-4d99-95fb-8d93dc96ce1d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Getting quotas for project df42ccb208664e04ac753b0c64b4fab7. Resources: {'cores', 'ram', 'instances'} {{(pid=124334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:37:40.640313 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.quota [None req-7ce525b8-948f-4d99-95fb-8d93dc96ce1d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Getting quotas for user 0d7ed577305d48c795f280e49b438bfc and project df42ccb208664e04ac753b0c64b4fab7. Resources: {'cores', 'ram', 'instances'} {{(pid=124334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:37:40.645966 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-3254aeae-2076-4ae7-af94-18438733a697 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:40.646588 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-3254aeae-2076-4ae7-af94-18438733a697 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:40.656213 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-7ce525b8-948f-4d99-95fb-8d93dc96ce1d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Going to run 1 instances... {{(pid=124334) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 18:37:40.661324 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-7ce525b8-948f-4d99-95fb-8d93dc96ce1d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f2a0bb6-2fb3-4536-bee3-23e4e975f079',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 18:37:40.670192 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3254aeae-2076-4ae7-af94-18438733a697 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:40.670597 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3254aeae-2076-4ae7-af94-18438733a697 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:40.676753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3254aeae-2076-4ae7-af94-18438733a697 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:40.677383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3254aeae-2076-4ae7-af94-18438733a697 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:40.744597 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-7ce525b8-948f-4d99-95fb-8d93dc96ce1d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.198654 Jul 31 18:37:40.745418 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 32/62] 10.222.0.49 () {60 vars in 1147 bytes} [Sun Jul 31 18:37:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 2207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 18:37:40.760109 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-805c67e8-8595-416f-ba48-f1231a6868ee tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:40.761159 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-805c67e8-8595-416f-ba48-f1231a6868ee tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:40.780510 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-3254aeae-2076-4ae7-af94-18438733a697 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:40.788939 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-805c67e8-8595-416f-ba48-f1231a6868ee tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:40.789506 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-3254aeae-2076-4ae7-af94-18438733a697 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:40.790649 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-805c67e8-8595-416f-ba48-f1231a6868ee tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:40.791284 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-3254aeae-2076-4ae7-af94-18438733a697 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:40.792222 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-805c67e8-8595-416f-ba48-f1231a6868ee tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:40.792460 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-3254aeae-2076-4ae7-af94-18438733a697 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1339 microversion: 2.20 time: 0.155392 Jul 31 18:37:40.793375 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 31/63] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:37:40 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1339 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:37:40.794367 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-805c67e8-8595-416f-ba48-f1231a6868ee tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:40.798030 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-9ad4939a-48ae-4b2d-b25e-4329e7d688b5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:40.798638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-9ad4939a-48ae-4b2d-b25e-4329e7d688b5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:40.804938 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9ad4939a-48ae-4b2d-b25e-4329e7d688b5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:40.805388 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9ad4939a-48ae-4b2d-b25e-4329e7d688b5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:40.806159 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9ad4939a-48ae-4b2d-b25e-4329e7d688b5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:40.806593 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9ad4939a-48ae-4b2d-b25e-4329e7d688b5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:40.893467 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-9ad4939a-48ae-4b2d-b25e-4329e7d688b5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:40.901828 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-9ad4939a-48ae-4b2d-b25e-4329e7d688b5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1233 microversion: 2.1 time: 0.107366 Jul 31 18:37:40.902802 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 32/64] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:40 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1233 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:40.906174 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-805c67e8-8595-416f-ba48-f1231a6868ee tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:40.908134 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-530b1b30-2a40-4061-b66f-52f840a1f4aa tempest-VolumesTestJSON-395641909 tempest-VolumesTestJSON-395641909-project] Calling method '.version_select at 0x7f870a4f5c10>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:40.916140 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-805c67e8-8595-416f-ba48-f1231a6868ee tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 200 len: 1246 microversion: 2.1 time: 0.169618 Jul 31 18:37:40.916905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 33/65] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:40 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 1246 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:40.923366 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-ac83ea3b-4782-4529-88d6-420d7e53b742 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:40.924418 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-ac83ea3b-4782-4529-88d6-420d7e53b742 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:41.013266 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-ac83ea3b-4782-4529-88d6-420d7e53b742 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:41.014305 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-530b1b30-2a40-4061-b66f-52f840a1f4aa tempest-VolumesTestJSON-395641909 tempest-VolumesTestJSON-395641909-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.110329 Jul 31 18:37:41.015035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 33/66] 10.222.0.49 () {58 vars in 1167 bytes} [Sun Jul 31 18:37:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:37:41.033951 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-ac83ea3b-4782-4529-88d6-420d7e53b742 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1222 microversion: 2.1 time: 0.115422 Jul 31 18:37:41.040959 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-2ed66fb8-8042-4ca2-83a5-d83c18949d78 tempest-VolumesTestJSON-395641909 tempest-VolumesTestJSON-395641909-project] Calling method '.version_select at 0x7f870a520ee0>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:41.049931 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 34/67] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:40 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1222 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:41.158407 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-2ed66fb8-8042-4ca2-83a5-d83c18949d78 tempest-VolumesTestJSON-395641909 tempest-VolumesTestJSON-395641909-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.125734 Jul 31 18:37:41.160064 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 34/68] 10.222.0.49 () {58 vars in 1170 bytes} [Sun Jul 31 18:37:41 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:37:41.173594 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-1932874b-85c1-4b49-8702-39f6db16c9f3 tempest-VolumesTestJSON-395641909 tempest-VolumesTestJSON-395641909-project] Calling method '.version_select at 0x7f870b570a60>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:41.293823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-1932874b-85c1-4b49-8702-39f6db16c9f3 tempest-VolumesTestJSON-395641909 tempest-VolumesTestJSON-395641909-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.124518 Jul 31 18:37:41.302914 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 35/69] 10.222.0.49 () {58 vars in 1155 bytes} [Sun Jul 31 18:37:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:37:41.309205 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-8d7e00ba-8efa-4f78-8e42-b04f3983d9aa tempest-VolumesTestJSON-395641909 tempest-VolumesTestJSON-395641909-project] Calling method '.version_select at 0x7f870a4b4670>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:41.418062 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-8d7e00ba-8efa-4f78-8e42-b04f3983d9aa tempest-VolumesTestJSON-395641909 tempest-VolumesTestJSON-395641909-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.113644 Jul 31 18:37:41.419072 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 35/70] 10.222.0.49 () {58 vars in 1188 bytes} [Sun Jul 31 18:37:41 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:37:41.434539 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-ddb3669f-c60a-402d-9215-f9cf7e2acb1b tempest-VolumesTestJSON-395641909 tempest-VolumesTestJSON-395641909-project] Calling method '.version_select at 0x7f870a4d65e0>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:41.534771 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-ddb3669f-c60a-402d-9215-f9cf7e2acb1b tempest-VolumesTestJSON-395641909 tempest-VolumesTestJSON-395641909-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.104613 Jul 31 18:37:41.535432 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 36/71] 10.222.0.49 () {58 vars in 1155 bytes} [Sun Jul 31 18:37:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:41.652087 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-10b69a4b-24d6-4fab-ae6a-6a0ab5deb69f tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:41.652688 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-10b69a4b-24d6-4fab-ae6a-6a0ab5deb69f tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:41.659676 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-10b69a4b-24d6-4fab-ae6a-6a0ab5deb69f tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:41.659993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-10b69a4b-24d6-4fab-ae6a-6a0ab5deb69f tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:41.660746 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-10b69a4b-24d6-4fab-ae6a-6a0ab5deb69f tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:41.665446 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-10b69a4b-24d6-4fab-ae6a-6a0ab5deb69f tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:41.812089 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-10b69a4b-24d6-4fab-ae6a-6a0ab5deb69f tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e518e5691a7247de9d04ae9828809498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eb8b8a120e4e87b4407d0abb3b3f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:41.817003 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-22dcfc8e-551b-436e-8820-4b988d47f825 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:41.818007 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-22dcfc8e-551b-436e-8820-4b988d47f825 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:41.819720 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-10b69a4b-24d6-4fab-ae6a-6a0ab5deb69f tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 200 len: 1314 microversion: 2.1 time: 0.172247 Jul 31 18:37:41.820300 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 36/72] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:41 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:41.825010 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-22dcfc8e-551b-436e-8820-4b988d47f825 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:41.825653 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-22dcfc8e-551b-436e-8820-4b988d47f825 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:41.826607 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-22dcfc8e-551b-436e-8820-4b988d47f825 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:41.827178 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-22dcfc8e-551b-436e-8820-4b988d47f825 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:41.899308 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-22dcfc8e-551b-436e-8820-4b988d47f825 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:41.907301 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-22dcfc8e-551b-436e-8820-4b988d47f825 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:41.909015 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-22dcfc8e-551b-436e-8820-4b988d47f825 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:41.910242 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-22dcfc8e-551b-436e-8820-4b988d47f825 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1339 microversion: 2.20 time: 0.098455 Jul 31 18:37:41.910791 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 37/73] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:37:41 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1339 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 18:37:41.923645 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-b4079f78-9a75-4dd2-9527-46d00dc86ed1 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:41.924548 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-b4079f78-9a75-4dd2-9527-46d00dc86ed1 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:41.930967 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b4079f78-9a75-4dd2-9527-46d00dc86ed1 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:41.931575 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b4079f78-9a75-4dd2-9527-46d00dc86ed1 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:41.932806 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b4079f78-9a75-4dd2-9527-46d00dc86ed1 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:41.933377 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b4079f78-9a75-4dd2-9527-46d00dc86ed1 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:41.941042 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4be246c6-564e-4a4b-9117-f1028d9778b6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:41.941981 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-4be246c6-564e-4a4b-9117-f1028d9778b6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:41.948143 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4be246c6-564e-4a4b-9117-f1028d9778b6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:41.948658 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4be246c6-564e-4a4b-9117-f1028d9778b6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:41.949691 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4be246c6-564e-4a4b-9117-f1028d9778b6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:41.950787 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4be246c6-564e-4a4b-9117-f1028d9778b6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:42.031613 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-4be246c6-564e-4a4b-9117-f1028d9778b6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:42.041591 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-b4079f78-9a75-4dd2-9527-46d00dc86ed1 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:42.048373 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-4be246c6-564e-4a4b-9117-f1028d9778b6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 200 len: 1246 microversion: 2.1 time: 0.115032 Jul 31 18:37:42.049499 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 38/74] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:41 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 1246 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:37:42.050368 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-b4079f78-9a75-4dd2-9527-46d00dc86ed1 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1233 microversion: 2.1 time: 0.130869 Jul 31 18:37:42.051412 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 37/75] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:41 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1233 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:42.059709 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-e2860628-faaf-40da-a38a-8ec643282417 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:42.060366 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-e2860628-faaf-40da-a38a-8ec643282417 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:42.066423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e2860628-faaf-40da-a38a-8ec643282417 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:42.066973 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e2860628-faaf-40da-a38a-8ec643282417 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:42.067883 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e2860628-faaf-40da-a38a-8ec643282417 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:42.068220 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e2860628-faaf-40da-a38a-8ec643282417 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:42.157506 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-e2860628-faaf-40da-a38a-8ec643282417 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:42.185140 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-e2860628-faaf-40da-a38a-8ec643282417 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1226 microversion: 2.1 time: 0.113304 Jul 31 18:37:42.190854 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 39/76] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:42 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1226 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:42.842190 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-05b74120-d648-4631-bbd3-8a65a08b96ce tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:42.842795 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-05b74120-d648-4631-bbd3-8a65a08b96ce tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:42.850075 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-05b74120-d648-4631-bbd3-8a65a08b96ce tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:42.850824 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-05b74120-d648-4631-bbd3-8a65a08b96ce tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:42.852260 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-05b74120-d648-4631-bbd3-8a65a08b96ce tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:42.853172 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-05b74120-d648-4631-bbd3-8a65a08b96ce tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:42.935298 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-b27b8d2a-0166-4269-8953-24a4600f69cc tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:42.936560 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-b27b8d2a-0166-4269-8953-24a4600f69cc tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:42.951245 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b27b8d2a-0166-4269-8953-24a4600f69cc tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:42.952257 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b27b8d2a-0166-4269-8953-24a4600f69cc tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:42.954001 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b27b8d2a-0166-4269-8953-24a4600f69cc tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:42.954941 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b27b8d2a-0166-4269-8953-24a4600f69cc tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:43.075827 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-05b74120-d648-4631-bbd3-8a65a08b96ce tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e518e5691a7247de9d04ae9828809498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eb8b8a120e4e87b4407d0abb3b3f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:43.084050 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-05b74120-d648-4631-bbd3-8a65a08b96ce tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 200 len: 1314 microversion: 2.1 time: 0.246683 Jul 31 18:37:43.085106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 38/77] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:42 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:43.090193 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-e7facaf6-32e7-4b60-9ffa-1ebae70f190e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:43.091101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-e7facaf6-32e7-4b60-9ffa-1ebae70f190e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:43.094611 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-b27b8d2a-0166-4269-8953-24a4600f69cc tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:43.104459 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-b27b8d2a-0166-4269-8953-24a4600f69cc tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:43.108397 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-b27b8d2a-0166-4269-8953-24a4600f69cc tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:43.111666 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-b27b8d2a-0166-4269-8953-24a4600f69cc tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1339 microversion: 2.20 time: 0.182640 Jul 31 18:37:43.112268 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e7facaf6-32e7-4b60-9ffa-1ebae70f190e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:43.112396 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 40/78] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:37:42 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1339 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:37:43.114523 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e7facaf6-32e7-4b60-9ffa-1ebae70f190e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:43.115352 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e7facaf6-32e7-4b60-9ffa-1ebae70f190e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:43.115789 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e7facaf6-32e7-4b60-9ffa-1ebae70f190e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:43.128482 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-923247de-dd5c-4804-97bf-c813f06632f4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:43.129511 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-923247de-dd5c-4804-97bf-c813f06632f4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:43.140074 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-923247de-dd5c-4804-97bf-c813f06632f4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:43.140797 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-923247de-dd5c-4804-97bf-c813f06632f4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:43.141599 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-923247de-dd5c-4804-97bf-c813f06632f4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:43.142026 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-923247de-dd5c-4804-97bf-c813f06632f4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:43.222025 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-e7facaf6-32e7-4b60-9ffa-1ebae70f190e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:43.224137 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-923247de-dd5c-4804-97bf-c813f06632f4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:43.238159 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-e7facaf6-32e7-4b60-9ffa-1ebae70f190e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 200 len: 1246 microversion: 2.1 time: 0.151476 Jul 31 18:37:43.239929 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-923247de-dd5c-4804-97bf-c813f06632f4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1289 microversion: 2.1 time: 0.126375 Jul 31 18:37:43.240132 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 39/79] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:43 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 1246 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:43.246028 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-eb82084e-ed3a-4017-a71b-a507775ef707 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:43.246988 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-eb82084e-ed3a-4017-a71b-a507775ef707 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:43.252184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 41/80] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:43 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1289 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:43.264196 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-eb82084e-ed3a-4017-a71b-a507775ef707 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:43.264642 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-eb82084e-ed3a-4017-a71b-a507775ef707 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:43.265539 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-eb82084e-ed3a-4017-a71b-a507775ef707 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:43.266043 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-eb82084e-ed3a-4017-a71b-a507775ef707 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:43.340367 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-eb82084e-ed3a-4017-a71b-a507775ef707 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:43.350353 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-eb82084e-ed3a-4017-a71b-a507775ef707 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1226 microversion: 2.1 time: 0.108971 Jul 31 18:37:43.351307 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 40/81] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:43 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:44.105154 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-ead0ac91-66cc-43c7-ae95-6c9cb82bbfdf tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:44.106407 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-ead0ac91-66cc-43c7-ae95-6c9cb82bbfdf tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:44.112747 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ead0ac91-66cc-43c7-ae95-6c9cb82bbfdf tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:44.113460 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ead0ac91-66cc-43c7-ae95-6c9cb82bbfdf tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:44.114270 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ead0ac91-66cc-43c7-ae95-6c9cb82bbfdf tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:44.114939 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ead0ac91-66cc-43c7-ae95-6c9cb82bbfdf tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:44.138382 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-acd1c473-4b5d-47af-a69c-7bfe1b8bcea3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:44.142209 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-acd1c473-4b5d-47af-a69c-7bfe1b8bcea3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:44.152712 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-acd1c473-4b5d-47af-a69c-7bfe1b8bcea3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:44.153873 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-acd1c473-4b5d-47af-a69c-7bfe1b8bcea3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:44.156267 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-acd1c473-4b5d-47af-a69c-7bfe1b8bcea3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:44.157009 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-acd1c473-4b5d-47af-a69c-7bfe1b8bcea3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:44.411123 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-ead0ac91-66cc-43c7-ae95-6c9cb82bbfdf tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e518e5691a7247de9d04ae9828809498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eb8b8a120e4e87b4407d0abb3b3f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:44.424285 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-ead0ac91-66cc-43c7-ae95-6c9cb82bbfdf tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 200 len: 1314 microversion: 2.1 time: 0.322996 Jul 31 18:37:44.425100 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 42/82] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:44 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:44.429882 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-acd1c473-4b5d-47af-a69c-7bfe1b8bcea3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:44.431059 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-90293efe-5d47-4634-ae1d-896085c611a4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:44.431678 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-90293efe-5d47-4634-ae1d-896085c611a4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:44.445190 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-acd1c473-4b5d-47af-a69c-7bfe1b8bcea3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:44.452915 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-acd1c473-4b5d-47af-a69c-7bfe1b8bcea3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:44.454433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-acd1c473-4b5d-47af-a69c-7bfe1b8bcea3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1339 microversion: 2.20 time: 0.323047 Jul 31 18:37:44.455015 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 41/83] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:37:44 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1339 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:37:44.456827 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-90293efe-5d47-4634-ae1d-896085c611a4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:44.457478 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-90293efe-5d47-4634-ae1d-896085c611a4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:44.458596 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-90293efe-5d47-4634-ae1d-896085c611a4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:44.459379 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-90293efe-5d47-4634-ae1d-896085c611a4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:44.470767 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-b2b756e1-b0b8-46db-8e3a-617504726e10 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:44.471386 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-b2b756e1-b0b8-46db-8e3a-617504726e10 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:44.478500 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b2b756e1-b0b8-46db-8e3a-617504726e10 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:44.478949 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b2b756e1-b0b8-46db-8e3a-617504726e10 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:44.479731 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b2b756e1-b0b8-46db-8e3a-617504726e10 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:44.480165 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b2b756e1-b0b8-46db-8e3a-617504726e10 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:44.550275 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-90293efe-5d47-4634-ae1d-896085c611a4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:44.559543 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-90293efe-5d47-4634-ae1d-896085c611a4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 200 len: 1246 microversion: 2.1 time: 0.133230 Jul 31 18:37:44.560942 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 43/84] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:44 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 1246 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:44.574349 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f33b638f-146d-45f8-9648-88e06d2f0465 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:44.575330 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-f33b638f-146d-45f8-9648-88e06d2f0465 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:44.582457 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f33b638f-146d-45f8-9648-88e06d2f0465 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:44.583079 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f33b638f-146d-45f8-9648-88e06d2f0465 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:44.583992 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f33b638f-146d-45f8-9648-88e06d2f0465 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:44.584563 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f33b638f-146d-45f8-9648-88e06d2f0465 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:44.668142 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-b2b756e1-b0b8-46db-8e3a-617504726e10 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:44.680983 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-f33b638f-146d-45f8-9648-88e06d2f0465 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:44.684384 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-b2b756e1-b0b8-46db-8e3a-617504726e10 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1289 microversion: 2.1 time: 0.226456 Jul 31 18:37:44.698552 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 42/85] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:44 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1289 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:44.704460 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-f33b638f-146d-45f8-9648-88e06d2f0465 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1218 microversion: 2.1 time: 0.142313 Jul 31 18:37:44.705082 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 44/86] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:44 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1218 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:45.445991 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-cea97847-a1a4-4c22-8971-a5c63626da85 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:45.447248 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-cea97847-a1a4-4c22-8971-a5c63626da85 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:45.455964 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cea97847-a1a4-4c22-8971-a5c63626da85 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:45.456638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cea97847-a1a4-4c22-8971-a5c63626da85 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:45.457608 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cea97847-a1a4-4c22-8971-a5c63626da85 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:45.461461 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cea97847-a1a4-4c22-8971-a5c63626da85 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:45.479120 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-d0951191-3c08-4cb7-be54-08110649e079 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:45.480061 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-d0951191-3c08-4cb7-be54-08110649e079 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:45.493361 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d0951191-3c08-4cb7-be54-08110649e079 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:45.493808 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d0951191-3c08-4cb7-be54-08110649e079 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:45.494725 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d0951191-3c08-4cb7-be54-08110649e079 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:45.495314 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d0951191-3c08-4cb7-be54-08110649e079 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:45.673436 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-cea97847-a1a4-4c22-8971-a5c63626da85 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e518e5691a7247de9d04ae9828809498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eb8b8a120e4e87b4407d0abb3b3f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:45.684554 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-cea97847-a1a4-4c22-8971-a5c63626da85 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 200 len: 1314 microversion: 2.1 time: 0.242660 Jul 31 18:37:45.693802 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 43/87] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:45 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:45.709843 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-313dd963-fddf-411d-8f2b-1db5fc675e87 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:45.710465 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-313dd963-fddf-411d-8f2b-1db5fc675e87 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:45.729128 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-313dd963-fddf-411d-8f2b-1db5fc675e87 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:45.731364 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-313dd963-fddf-411d-8f2b-1db5fc675e87 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:45.732247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-313dd963-fddf-411d-8f2b-1db5fc675e87 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:45.732688 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-313dd963-fddf-411d-8f2b-1db5fc675e87 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:45.809428 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-d0951191-3c08-4cb7-be54-08110649e079 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:45.825925 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-d0951191-3c08-4cb7-be54-08110649e079 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:45.826247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-313dd963-fddf-411d-8f2b-1db5fc675e87 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:45.828962 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-d0951191-3c08-4cb7-be54-08110649e079 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:45.830138 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-d0951191-3c08-4cb7-be54-08110649e079 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1407 microversion: 2.20 time: 0.356697 Jul 31 18:37:45.831028 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 45/88] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:37:45 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1407 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 18:37:45.835628 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-24791877-4d50-4f3f-9978-ad3ae6e40055 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:45.836386 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-24791877-4d50-4f3f-9978-ad3ae6e40055 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:45.858058 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-313dd963-fddf-411d-8f2b-1db5fc675e87 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 200 len: 1294 microversion: 2.1 time: 0.160208 Jul 31 18:37:45.858801 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 44/89] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:45 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 1294 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:45.867344 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-93908d43-b07d-484f-a18e-a031a141b949 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:45.867950 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-93908d43-b07d-484f-a18e-a031a141b949 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:45.869775 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-24791877-4d50-4f3f-9978-ad3ae6e40055 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:45.870279 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-24791877-4d50-4f3f-9978-ad3ae6e40055 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:45.871129 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-24791877-4d50-4f3f-9978-ad3ae6e40055 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:45.871562 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-24791877-4d50-4f3f-9978-ad3ae6e40055 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:45.885512 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-93908d43-b07d-484f-a18e-a031a141b949 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:45.887809 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-93908d43-b07d-484f-a18e-a031a141b949 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:45.890023 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-93908d43-b07d-484f-a18e-a031a141b949 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:45.891178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-93908d43-b07d-484f-a18e-a031a141b949 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:45.914291 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=100 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:45.960595 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-24791877-4d50-4f3f-9978-ad3ae6e40055 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:45.975679 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-24791877-4d50-4f3f-9978-ad3ae6e40055 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1295 microversion: 2.1 time: 0.143421 Jul 31 18:37:45.976408 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 46/90] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:45 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1295 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:45.998019 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-93908d43-b07d-484f-a18e-a031a141b949 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:46.008588 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-93908d43-b07d-484f-a18e-a031a141b949 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1274 microversion: 2.1 time: 0.148758 Jul 31 18:37:46.009785 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 45/91] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:45 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1274 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:46.705707 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f0aa6e0a-e9db-48bc-9f6f-40f548af5a4f tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:46.706986 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-f0aa6e0a-e9db-48bc-9f6f-40f548af5a4f tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:46.721592 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f0aa6e0a-e9db-48bc-9f6f-40f548af5a4f tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:46.722313 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f0aa6e0a-e9db-48bc-9f6f-40f548af5a4f tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:46.723335 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f0aa6e0a-e9db-48bc-9f6f-40f548af5a4f tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:46.723976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f0aa6e0a-e9db-48bc-9f6f-40f548af5a4f tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:46.743416 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=100 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:46.857094 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-9ffbc871-8a5e-413e-ba47-155655133c57 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:46.857917 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-9ffbc871-8a5e-413e-ba47-155655133c57 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:46.874898 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9ffbc871-8a5e-413e-ba47-155655133c57 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:46.881432 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9ffbc871-8a5e-413e-ba47-155655133c57 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:46.884143 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9ffbc871-8a5e-413e-ba47-155655133c57 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:46.886163 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9ffbc871-8a5e-413e-ba47-155655133c57 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:47.129670 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-f0aa6e0a-e9db-48bc-9f6f-40f548af5a4f tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e518e5691a7247de9d04ae9828809498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eb8b8a120e4e87b4407d0abb3b3f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:47.163396 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-f0aa6e0a-e9db-48bc-9f6f-40f548af5a4f tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 200 len: 1314 microversion: 2.1 time: 0.461333 Jul 31 18:37:47.164487 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 47/92] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:46 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:47.172212 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f090f8cf-d652-455c-9349-99ace0783c99 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:47.174794 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-f090f8cf-d652-455c-9349-99ace0783c99 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:47.183417 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f090f8cf-d652-455c-9349-99ace0783c99 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:47.184590 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f090f8cf-d652-455c-9349-99ace0783c99 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:47.186560 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f090f8cf-d652-455c-9349-99ace0783c99 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:47.187166 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f090f8cf-d652-455c-9349-99ace0783c99 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:47.312920 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-f090f8cf-d652-455c-9349-99ace0783c99 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:47.322805 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-f090f8cf-d652-455c-9349-99ace0783c99 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 200 len: 1300 microversion: 2.1 time: 0.156485 Jul 31 18:37:47.324693 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 48/93] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:47 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 1300 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:47.332605 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-c932e48d-9536-4911-ad2a-a8a837f242e4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:47.336564 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-c932e48d-9536-4911-ad2a-a8a837f242e4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:47.344436 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:47.350828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c932e48d-9536-4911-ad2a-a8a837f242e4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:47.357605 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c932e48d-9536-4911-ad2a-a8a837f242e4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:47.358571 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c932e48d-9536-4911-ad2a-a8a837f242e4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:47.359113 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c932e48d-9536-4911-ad2a-a8a837f242e4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:47.505312 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-c932e48d-9536-4911-ad2a-a8a837f242e4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:47.528779 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-c932e48d-9536-4911-ad2a-a8a837f242e4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1295 microversion: 2.1 time: 0.201995 Jul 31 18:37:47.537569 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 49/94] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:47 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1295 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:47.543292 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-bf29a634-9fbf-4c38-bec5-67cfffbbaa8c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:47.546352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-bf29a634-9fbf-4c38-bec5-67cfffbbaa8c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:47.565344 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-bf29a634-9fbf-4c38-bec5-67cfffbbaa8c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:47.570475 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-bf29a634-9fbf-4c38-bec5-67cfffbbaa8c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:47.571971 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-bf29a634-9fbf-4c38-bec5-67cfffbbaa8c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:47.574706 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-bf29a634-9fbf-4c38-bec5-67cfffbbaa8c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:47.688908 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-9ffbc871-8a5e-413e-ba47-155655133c57 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:47.709061 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-9ffbc871-8a5e-413e-ba47-155655133c57 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:47.711946 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-9ffbc871-8a5e-413e-ba47-155655133c57 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:47.714207 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-9ffbc871-8a5e-413e-ba47-155655133c57 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1407 microversion: 2.20 time: 0.862501 Jul 31 18:37:47.714923 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 46/95] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:37:46 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1407 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:37:47.734557 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-bf29a634-9fbf-4c38-bec5-67cfffbbaa8c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:47.773943 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-bf29a634-9fbf-4c38-bec5-67cfffbbaa8c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1280 microversion: 2.1 time: 0.234434 Jul 31 18:37:47.777550 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 50/96] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:47 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1280 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:48.187451 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-b29ad3c1-8081-4861-bb45-826589154426 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:48.188245 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-b29ad3c1-8081-4861-bb45-826589154426 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:48.200569 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b29ad3c1-8081-4861-bb45-826589154426 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:48.201185 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b29ad3c1-8081-4861-bb45-826589154426 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:48.206179 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b29ad3c1-8081-4861-bb45-826589154426 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:48.206651 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b29ad3c1-8081-4861-bb45-826589154426 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:48.584868 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-b29ad3c1-8081-4861-bb45-826589154426 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e518e5691a7247de9d04ae9828809498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eb8b8a120e4e87b4407d0abb3b3f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:48.597121 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-b29ad3c1-8081-4861-bb45-826589154426 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 200 len: 1314 microversion: 2.1 time: 0.414661 Jul 31 18:37:48.602562 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 51/97] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:48 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:48.610021 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-cfd17bcc-260f-48f8-99e7-773a47b6e1f1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:48.610801 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-cfd17bcc-260f-48f8-99e7-773a47b6e1f1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:48.619838 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-97ad405b-b031-4a2d-a3a5-56379c5e239d req-3140cdef-02f0-445a-b951-b293a7945faf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "432e6c6a-9a11-4f18-8dbe-fbb82e95f39f", "tag": "2a079287-92d9-4c25-bdec-babc0efb1738"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:37:48.636027 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cfd17bcc-260f-48f8-99e7-773a47b6e1f1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:48.637381 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cfd17bcc-260f-48f8-99e7-773a47b6e1f1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:48.639020 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cfd17bcc-260f-48f8-99e7-773a47b6e1f1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:48.642565 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cfd17bcc-260f-48f8-99e7-773a47b6e1f1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:48.648558 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-97ad405b-b031-4a2d-a3a5-56379c5e239d req-3140cdef-02f0-445a-b951-b293a7945faf service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:48.649026 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-97ad405b-b031-4a2d-a3a5-56379c5e239d req-3140cdef-02f0-445a-b951-b293a7945faf service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:48.712905 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-97ad405b-b031-4a2d-a3a5-56379c5e239d req-3140cdef-02f0-445a-b951-b293a7945faf service nova] Creating event network-changed:2a079287-92d9-4c25-bdec-babc0efb1738 for instance 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f on hv-cinder-84984 Jul 31 18:37:48.713557 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-97ad405b-b031-4a2d-a3a5-56379c5e239d req-3140cdef-02f0-445a-b951-b293a7945faf service nova] Acquired lock "compute-rpcapi-router" {{(pid=124333) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 31 18:37:48.714683 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ab1ad662-4af4-4ef4-968e-139109457915 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:48.715116 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ab1ad662-4af4-4ef4-968e-139109457915 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:48.715879 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ab1ad662-4af4-4ef4-968e-139109457915 None None] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:48.716307 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ab1ad662-4af4-4ef4-968e-139109457915 None None] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:48.743134 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.compute.rpcapi [None req-ab1ad662-4af4-4ef4-968e-139109457915 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 31 18:37:48.744071 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ab1ad662-4af4-4ef4-968e-139109457915 None None] Releasing lock "compute-rpcapi-router" {{(pid=124333) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 31 18:37:48.777950 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-ab1ad662-4af4-4ef4-968e-139109457915 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.626647 Jul 31 18:37:48.779527 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 47/98] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:37:48.780939 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-cfd17bcc-260f-48f8-99e7-773a47b6e1f1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:48.786690 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-d8795877-bcb1-48a4-8d89-1721e982670d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:48.787888 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-d8795877-bcb1-48a4-8d89-1721e982670d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:48.790850 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-cfd17bcc-260f-48f8-99e7-773a47b6e1f1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 200 len: 1300 microversion: 2.1 time: 0.186563 Jul 31 18:37:48.795873 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d8795877-bcb1-48a4-8d89-1721e982670d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:48.796505 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d8795877-bcb1-48a4-8d89-1721e982670d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:48.797785 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d8795877-bcb1-48a4-8d89-1721e982670d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:48.798801 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d8795877-bcb1-48a4-8d89-1721e982670d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:48.808254 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 52/99] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:48 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 1300 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:48.818862 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-3cdaa635-f7b5-45ea-9bad-4ed0e59934a8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:48.819576 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-3cdaa635-f7b5-45ea-9bad-4ed0e59934a8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:48.826785 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3cdaa635-f7b5-45ea-9bad-4ed0e59934a8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:48.827233 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3cdaa635-f7b5-45ea-9bad-4ed0e59934a8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:48.828346 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3cdaa635-f7b5-45ea-9bad-4ed0e59934a8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:48.828951 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3cdaa635-f7b5-45ea-9bad-4ed0e59934a8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:49.001378 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-3cdaa635-f7b5-45ea-9bad-4ed0e59934a8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:49.012202 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-3cdaa635-f7b5-45ea-9bad-4ed0e59934a8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:49.014404 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-3cdaa635-f7b5-45ea-9bad-4ed0e59934a8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:49.016098 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-3cdaa635-f7b5-45ea-9bad-4ed0e59934a8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1407 microversion: 2.20 time: 0.206724 Jul 31 18:37:49.018277 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 53/100] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:37:48 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:37:49.034106 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-788cca2c-d9f7-4826-9f7f-e4c5a51ebf83 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:49.036549 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-788cca2c-d9f7-4826-9f7f-e4c5a51ebf83 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:49.046835 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-788cca2c-d9f7-4826-9f7f-e4c5a51ebf83 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:49.047634 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-788cca2c-d9f7-4826-9f7f-e4c5a51ebf83 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:49.048917 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-788cca2c-d9f7-4826-9f7f-e4c5a51ebf83 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:49.050458 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-788cca2c-d9f7-4826-9f7f-e4c5a51ebf83 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:49.128070 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-788cca2c-d9f7-4826-9f7f-e4c5a51ebf83 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:49.138722 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-788cca2c-d9f7-4826-9f7f-e4c5a51ebf83 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1280 microversion: 2.1 time: 0.118485 Jul 31 18:37:49.139724 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 54/101] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:49 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1280 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:49.252612 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-d8795877-bcb1-48a4-8d89-1721e982670d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:49.263448 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-d8795877-bcb1-48a4-8d89-1721e982670d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1295 microversion: 2.1 time: 0.481647 Jul 31 18:37:49.277548 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 48/102] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:48 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1295 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:49.623871 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-e1652990-5808-41ea-b2b4-f63bed701b60 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:49.624470 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-e1652990-5808-41ea-b2b4-f63bed701b60 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:49.640543 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e1652990-5808-41ea-b2b4-f63bed701b60 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:49.641018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e1652990-5808-41ea-b2b4-f63bed701b60 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:49.641790 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e1652990-5808-41ea-b2b4-f63bed701b60 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:49.642217 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e1652990-5808-41ea-b2b4-f63bed701b60 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:49.770097 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-fd2383c4-97bf-4caf-9bae-b558f1ead745 req-f7a149a9-e68b-43d1-ac63-66bb8a42e2d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c", "tag": "7bcdc20b-6ddb-46c2-ba36-8f9cc27cf413"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:37:49.805347 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell0:SELECT=32 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:49.807859 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-fd2383c4-97bf-4caf-9bae-b558f1ead745 req-f7a149a9-e68b-43d1-ac63-66bb8a42e2d1 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:49.808668 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-fd2383c4-97bf-4caf-9bae-b558f1ead745 req-f7a149a9-e68b-43d1-ac63-66bb8a42e2d1 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:49.833007 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-fd2383c4-97bf-4caf-9bae-b558f1ead745 req-f7a149a9-e68b-43d1-ac63-66bb8a42e2d1 service nova] Creating event network-changed:7bcdc20b-6ddb-46c2-ba36-8f9cc27cf413 for instance 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c on hv-cinder-84984 Jul 31 18:37:49.838462 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-fd2383c4-97bf-4caf-9bae-b558f1ead745 req-f7a149a9-e68b-43d1-ac63-66bb8a42e2d1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073755 Jul 31 18:37:49.839073 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 49/103] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:37:49.932791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-bcecb7dd-162a-4b9b-bd56-830e170a60e2 req-2dd6ae7c-f118-4c5b-a379-54d68607266a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3c5c619-b8b1-4c29-b8a1-e7427f571386", "name": "network-vif-plugged", "status": "completed", "tag": "c9421a90-d6c6-4c5a-8004-5b32536878d2"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:37:49.945298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-bcecb7dd-162a-4b9b-bd56-830e170a60e2 req-2dd6ae7c-f118-4c5b-a379-54d68607266a service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:49.945736 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-bcecb7dd-162a-4b9b-bd56-830e170a60e2 req-2dd6ae7c-f118-4c5b-a379-54d68607266a service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:49.960971 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-bcecb7dd-162a-4b9b-bd56-830e170a60e2 req-2dd6ae7c-f118-4c5b-a379-54d68607266a service nova] Creating event network-vif-plugged:c9421a90-d6c6-4c5a-8004-5b32536878d2 for instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 on hv-cinder-84984 Jul 31 18:37:49.967026 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-bcecb7dd-162a-4b9b-bd56-830e170a60e2 req-2dd6ae7c-f118-4c5b-a379-54d68607266a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121503 Jul 31 18:37:49.967706 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 50/104] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:37:49.994152 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-db36ccfc-9991-439b-8b25-3e395fdd1cfe tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:49.998525 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-db36ccfc-9991-439b-8b25-3e395fdd1cfe tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:50.032832 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-db36ccfc-9991-439b-8b25-3e395fdd1cfe tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:50.040348 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-db36ccfc-9991-439b-8b25-3e395fdd1cfe tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:50.043149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-db36ccfc-9991-439b-8b25-3e395fdd1cfe tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:50.045852 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-db36ccfc-9991-439b-8b25-3e395fdd1cfe tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:50.130364 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-e1652990-5808-41ea-b2b4-f63bed701b60 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e518e5691a7247de9d04ae9828809498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eb8b8a120e4e87b4407d0abb3b3f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:50.148615 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-e1652990-5808-41ea-b2b4-f63bed701b60 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 200 len: 1314 microversion: 2.1 time: 0.519783 Jul 31 18:37:50.165774 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 55/105] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:49 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:50.171851 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-ad23cc73-ca11-4e2e-861a-6e780298b422 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:50.172878 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-ad23cc73-ca11-4e2e-861a-6e780298b422 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:50.179960 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ad23cc73-ca11-4e2e-861a-6e780298b422 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:50.180718 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ad23cc73-ca11-4e2e-861a-6e780298b422 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:50.181806 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ad23cc73-ca11-4e2e-861a-6e780298b422 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:50.182465 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ad23cc73-ca11-4e2e-861a-6e780298b422 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:50.533166 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-db36ccfc-9991-439b-8b25-3e395fdd1cfe tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:50.545592 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-db36ccfc-9991-439b-8b25-3e395fdd1cfe tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 200 len: 1300 microversion: 2.1 time: 0.572737 Jul 31 18:37:50.547988 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 51/106] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:49 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 1300 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:50.554741 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-d8c6ed7f-0122-4a69-989d-73a5e6c4ec6b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:50.555339 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-d8c6ed7f-0122-4a69-989d-73a5e6c4ec6b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:50.564183 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d8c6ed7f-0122-4a69-989d-73a5e6c4ec6b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:50.564633 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d8c6ed7f-0122-4a69-989d-73a5e6c4ec6b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:50.565449 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d8c6ed7f-0122-4a69-989d-73a5e6c4ec6b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:50.565886 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d8c6ed7f-0122-4a69-989d-73a5e6c4ec6b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:50.615033 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell0:SELECT=6 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:50.738773 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-d8c6ed7f-0122-4a69-989d-73a5e6c4ec6b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:50.746407 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-d8c6ed7f-0122-4a69-989d-73a5e6c4ec6b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1280 microversion: 2.1 time: 0.195276 Jul 31 18:37:50.760199 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 52/107] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:50 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1280 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:50.765243 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-6dbb78dc-5557-47b2-990f-801df0b74deb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:50.765741 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-6dbb78dc-5557-47b2-990f-801df0b74deb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:50.772481 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6dbb78dc-5557-47b2-990f-801df0b74deb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:50.773145 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6dbb78dc-5557-47b2-990f-801df0b74deb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:50.773823 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6dbb78dc-5557-47b2-990f-801df0b74deb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:50.774631 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6dbb78dc-5557-47b2-990f-801df0b74deb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:50.810608 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-ad23cc73-ca11-4e2e-861a-6e780298b422 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:50.824291 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-ad23cc73-ca11-4e2e-861a-6e780298b422 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:50.826790 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-ad23cc73-ca11-4e2e-861a-6e780298b422 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:50.828100 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-ad23cc73-ca11-4e2e-861a-6e780298b422 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1407 microversion: 2.20 time: 0.660885 Jul 31 18:37:50.842381 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 56/108] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:37:50 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1407 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:37:51.171421 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-92756cc8-952c-444d-a868-fd1717b2ded2 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:51.173264 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-92756cc8-952c-444d-a868-fd1717b2ded2 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:51.176395 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell0:SELECT=24 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:51.184264 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-92756cc8-952c-444d-a868-fd1717b2ded2 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:51.184705 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-92756cc8-952c-444d-a868-fd1717b2ded2 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:51.185547 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-92756cc8-952c-444d-a868-fd1717b2ded2 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:51.185972 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-92756cc8-952c-444d-a868-fd1717b2ded2 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:51.402151 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-92756cc8-952c-444d-a868-fd1717b2ded2 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e518e5691a7247de9d04ae9828809498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eb8b8a120e4e87b4407d0abb3b3f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:51.425423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-92756cc8-952c-444d-a868-fd1717b2ded2 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 200 len: 1314 microversion: 2.1 time: 0.246871 Jul 31 18:37:51.426336 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 57/109] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:51 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:51.580558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-05678165-7a74-490a-85de-9f168ef5e843 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:51.580558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-05678165-7a74-490a-85de-9f168ef5e843 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:51.585758 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-05678165-7a74-490a-85de-9f168ef5e843 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:51.586286 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-05678165-7a74-490a-85de-9f168ef5e843 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:51.587451 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-05678165-7a74-490a-85de-9f168ef5e843 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:51.587973 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-05678165-7a74-490a-85de-9f168ef5e843 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:51.882221 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-05678165-7a74-490a-85de-9f168ef5e843 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:51.887203 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-6dbb78dc-5557-47b2-990f-801df0b74deb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:51.896151 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-6dbb78dc-5557-47b2-990f-801df0b74deb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1363 microversion: 2.1 time: 1.134708 Jul 31 18:37:51.898175 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 53/110] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:50 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1363 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:51.900360 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-05678165-7a74-490a-85de-9f168ef5e843 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 200 len: 1367 microversion: 2.1 time: 0.332709 Jul 31 18:37:51.901766 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 58/111] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:51 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 1367 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:37:51.908602 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-1aebd9c9-a9e0-4953-a5f6-7591f9e2ceaa tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:51.914691 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-1aebd9c9-a9e0-4953-a5f6-7591f9e2ceaa tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:51.917217 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-5d0bfcf6-65aa-4c6f-9200-e902437d71b0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:51.918340 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-5d0bfcf6-65aa-4c6f-9200-e902437d71b0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:51.927845 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5d0bfcf6-65aa-4c6f-9200-e902437d71b0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:51.929471 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5d0bfcf6-65aa-4c6f-9200-e902437d71b0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:51.930726 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5d0bfcf6-65aa-4c6f-9200-e902437d71b0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:51.931088 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1aebd9c9-a9e0-4953-a5f6-7591f9e2ceaa tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:51.931537 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1aebd9c9-a9e0-4953-a5f6-7591f9e2ceaa tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:51.932032 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5d0bfcf6-65aa-4c6f-9200-e902437d71b0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:51.932307 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1aebd9c9-a9e0-4953-a5f6-7591f9e2ceaa tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:51.932735 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1aebd9c9-a9e0-4953-a5f6-7591f9e2ceaa tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:52.113610 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-1aebd9c9-a9e0-4953-a5f6-7591f9e2ceaa tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:52.122260 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-1aebd9c9-a9e0-4953-a5f6-7591f9e2ceaa tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:52.124056 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-1aebd9c9-a9e0-4953-a5f6-7591f9e2ceaa tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:52.125198 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-1aebd9c9-a9e0-4953-a5f6-7591f9e2ceaa tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1407 microversion: 2.20 time: 0.222460 Jul 31 18:37:52.125754 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 59/112] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:37:51 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:37:52.451001 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-6d024408-3760-4f74-bc20-797e88889bfa tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:52.452507 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-6d024408-3760-4f74-bc20-797e88889bfa tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:52.461155 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6d024408-3760-4f74-bc20-797e88889bfa tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:52.462028 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6d024408-3760-4f74-bc20-797e88889bfa tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:52.463792 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6d024408-3760-4f74-bc20-797e88889bfa tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:52.464394 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6d024408-3760-4f74-bc20-797e88889bfa tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:52.503519 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-5d0bfcf6-65aa-4c6f-9200-e902437d71b0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:52.515311 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-5d0bfcf6-65aa-4c6f-9200-e902437d71b0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1322 microversion: 2.1 time: 0.615970 Jul 31 18:37:52.516959 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 54/113] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:51 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1322 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:52.685300 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-6d024408-3760-4f74-bc20-797e88889bfa tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e518e5691a7247de9d04ae9828809498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eb8b8a120e4e87b4407d0abb3b3f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:52.694318 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-6d024408-3760-4f74-bc20-797e88889bfa tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 200 len: 1314 microversion: 2.1 time: 0.249612 Jul 31 18:37:52.695319 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 60/114] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:52 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:37:52.921113 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-638cb0f9-6e05-4ebe-b06c-c9b40b127f2a tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:52.923101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-638cb0f9-6e05-4ebe-b06c-c9b40b127f2a tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:52.937902 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-638cb0f9-6e05-4ebe-b06c-c9b40b127f2a tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:52.938841 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-638cb0f9-6e05-4ebe-b06c-c9b40b127f2a tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:52.944394 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-638cb0f9-6e05-4ebe-b06c-c9b40b127f2a tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:52.945152 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-638cb0f9-6e05-4ebe-b06c-c9b40b127f2a tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:52.951958 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-d7eb453a-fd47-435e-9fdc-d9712497966f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:52.961002 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-d7eb453a-fd47-435e-9fdc-d9712497966f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:52.979129 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d7eb453a-fd47-435e-9fdc-d9712497966f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:52.980451 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d7eb453a-fd47-435e-9fdc-d9712497966f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:52.981787 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d7eb453a-fd47-435e-9fdc-d9712497966f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:52.983060 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d7eb453a-fd47-435e-9fdc-d9712497966f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:53.285441 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-d7eb453a-fd47-435e-9fdc-d9712497966f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:53.332670 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-d7eb453a-fd47-435e-9fdc-d9712497966f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 200 len: 1367 microversion: 2.1 time: 0.407279 Jul 31 18:37:53.333322 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 61/115] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:52 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 1367 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:53.342847 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-70856214-7324-40da-ba8c-621ed1decf48 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:53.344932 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-70856214-7324-40da-ba8c-621ed1decf48 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:53.359730 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-70856214-7324-40da-ba8c-621ed1decf48 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:53.360335 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-70856214-7324-40da-ba8c-621ed1decf48 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:53.362361 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-70856214-7324-40da-ba8c-621ed1decf48 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:53.363799 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-70856214-7324-40da-ba8c-621ed1decf48 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:53.379607 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-638cb0f9-6e05-4ebe-b06c-c9b40b127f2a tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:53.392111 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-638cb0f9-6e05-4ebe-b06c-c9b40b127f2a tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1363 microversion: 2.1 time: 0.476724 Jul 31 18:37:53.398879 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 55/116] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:52 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1363 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:53.468539 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-baac5c03-ce90-4fc8-9557-9b1527f04ad0 req-3dfc94b6-6973-4a59-b7eb-138660f302b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1577f8a-0f79-4b82-9afa-85c86f07cf92", "tag": "afbd6a66-843d-4087-b7a7-1be3dd6e4af4"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:37:53.483159 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-baac5c03-ce90-4fc8-9557-9b1527f04ad0 req-3dfc94b6-6973-4a59-b7eb-138660f302b1 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:53.483604 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-baac5c03-ce90-4fc8-9557-9b1527f04ad0 req-3dfc94b6-6973-4a59-b7eb-138660f302b1 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:53.523274 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-baac5c03-ce90-4fc8-9557-9b1527f04ad0 req-3dfc94b6-6973-4a59-b7eb-138660f302b1 service nova] Creating event network-changed:afbd6a66-843d-4087-b7a7-1be3dd6e4af4 for instance a1577f8a-0f79-4b82-9afa-85c86f07cf92 on hv-cinder-84984 Jul 31 18:37:53.529042 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-baac5c03-ce90-4fc8-9557-9b1527f04ad0 req-3dfc94b6-6973-4a59-b7eb-138660f302b1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064910 Jul 31 18:37:53.529638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 56/117] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:37:53.542227 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-93f82050-b827-49bd-afa1-91aff48cf41f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:53.545336 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-93f82050-b827-49bd-afa1-91aff48cf41f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:53.564284 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-93f82050-b827-49bd-afa1-91aff48cf41f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:53.564934 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-93f82050-b827-49bd-afa1-91aff48cf41f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:53.568170 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-93f82050-b827-49bd-afa1-91aff48cf41f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:53.568707 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-93f82050-b827-49bd-afa1-91aff48cf41f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:53.604521 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-70856214-7324-40da-ba8c-621ed1decf48 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:53.615102 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-70856214-7324-40da-ba8c-621ed1decf48 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:53.618042 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-70856214-7324-40da-ba8c-621ed1decf48 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:53.619435 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-70856214-7324-40da-ba8c-621ed1decf48 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1407 microversion: 2.20 time: 0.284852 Jul 31 18:37:53.620520 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 62/118] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:37:53 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1407 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:37:53.723521 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-5137926d-8928-411d-aa16-b2d6987be021 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:53.724301 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-5137926d-8928-411d-aa16-b2d6987be021 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:53.732973 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5137926d-8928-411d-aa16-b2d6987be021 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:53.734586 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5137926d-8928-411d-aa16-b2d6987be021 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:53.735978 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5137926d-8928-411d-aa16-b2d6987be021 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:53.736409 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5137926d-8928-411d-aa16-b2d6987be021 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:53.867899 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-93f82050-b827-49bd-afa1-91aff48cf41f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:53.881328 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-93f82050-b827-49bd-afa1-91aff48cf41f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1322 microversion: 2.1 time: 0.342767 Jul 31 18:37:53.882779 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 57/119] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:53 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1322 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:53.918901 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-5137926d-8928-411d-aa16-b2d6987be021 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e518e5691a7247de9d04ae9828809498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eb8b8a120e4e87b4407d0abb3b3f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:53.922350 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=100 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:53.927015 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-5137926d-8928-411d-aa16-b2d6987be021 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 200 len: 1314 microversion: 2.1 time: 0.208341 Jul 31 18:37:53.928981 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 63/120] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:53 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:54.355633 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-30ac530a-58ca-496d-b716-90b9f8d5b4ab tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:54.356229 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-30ac530a-58ca-496d-b716-90b9f8d5b4ab tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:54.362588 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-30ac530a-58ca-496d-b716-90b9f8d5b4ab tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:54.363123 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-30ac530a-58ca-496d-b716-90b9f8d5b4ab tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:54.363767 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-30ac530a-58ca-496d-b716-90b9f8d5b4ab tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:54.364204 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-30ac530a-58ca-496d-b716-90b9f8d5b4ab tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:54.416725 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-881d3a4c-2f7f-4b3c-9970-e146dc395766 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:54.417743 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-881d3a4c-2f7f-4b3c-9970-e146dc395766 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:54.426812 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-881d3a4c-2f7f-4b3c-9970-e146dc395766 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:54.427755 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-881d3a4c-2f7f-4b3c-9970-e146dc395766 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:54.428865 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-881d3a4c-2f7f-4b3c-9970-e146dc395766 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:54.429651 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-881d3a4c-2f7f-4b3c-9970-e146dc395766 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:54.525109 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-30ac530a-58ca-496d-b716-90b9f8d5b4ab tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:54.533655 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-30ac530a-58ca-496d-b716-90b9f8d5b4ab tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 200 len: 1367 microversion: 2.1 time: 0.181999 Jul 31 18:37:54.534770 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 58/121] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:54 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:54.594131 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-881d3a4c-2f7f-4b3c-9970-e146dc395766 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:54.605882 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-881d3a4c-2f7f-4b3c-9970-e146dc395766 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1363 microversion: 2.1 time: 0.194041 Jul 31 18:37:54.607156 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 64/122] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:54 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:54.643734 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-da976cbf-e253-429a-bf7e-8721150ad791 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:54.644570 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-da976cbf-e253-429a-bf7e-8721150ad791 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:54.652625 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-da976cbf-e253-429a-bf7e-8721150ad791 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:54.653380 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-da976cbf-e253-429a-bf7e-8721150ad791 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:54.654420 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-da976cbf-e253-429a-bf7e-8721150ad791 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:54.655063 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-da976cbf-e253-429a-bf7e-8721150ad791 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:54.807103 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-da976cbf-e253-429a-bf7e-8721150ad791 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:54.817544 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-da976cbf-e253-429a-bf7e-8721150ad791 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:54.819726 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-da976cbf-e253-429a-bf7e-8721150ad791 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:54.821534 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-da976cbf-e253-429a-bf7e-8721150ad791 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1407 microversion: 2.20 time: 0.181805 Jul 31 18:37:54.833993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 59/123] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:37:54 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:37:54.904230 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-591a0ac6-cbad-4fe5-95fc-e1a4d9878d15 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:54.904737 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-591a0ac6-cbad-4fe5-95fc-e1a4d9878d15 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:54.923606 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-591a0ac6-cbad-4fe5-95fc-e1a4d9878d15 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:54.923606 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-591a0ac6-cbad-4fe5-95fc-e1a4d9878d15 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:54.923817 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-591a0ac6-cbad-4fe5-95fc-e1a4d9878d15 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:54.924225 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-591a0ac6-cbad-4fe5-95fc-e1a4d9878d15 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:54.952258 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-9703d80d-a114-461a-9d91-e45ccefc58ef tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:54.952905 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-9703d80d-a114-461a-9d91-e45ccefc58ef tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:54.959474 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9703d80d-a114-461a-9d91-e45ccefc58ef tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:54.959909 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9703d80d-a114-461a-9d91-e45ccefc58ef tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:54.961071 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9703d80d-a114-461a-9d91-e45ccefc58ef tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:54.961741 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9703d80d-a114-461a-9d91-e45ccefc58ef tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:55.162875 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-591a0ac6-cbad-4fe5-95fc-e1a4d9878d15 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:55.173998 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-591a0ac6-cbad-4fe5-95fc-e1a4d9878d15 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1322 microversion: 2.1 time: 0.274406 Jul 31 18:37:55.175314 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 65/124] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:54 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:55.218143 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-9703d80d-a114-461a-9d91-e45ccefc58ef tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e518e5691a7247de9d04ae9828809498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eb8b8a120e4e87b4407d0abb3b3f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:55.229442 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-9703d80d-a114-461a-9d91-e45ccefc58ef tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 200 len: 1314 microversion: 2.1 time: 0.283810 Jul 31 18:37:55.230646 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 60/125] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:54 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:37:55.247109 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-e7338be8-3bb0-41a3-bdb2-370ae7602e05 req-a3ed7f73-840c-4735-9bf0-6a135e4affdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "432e6c6a-9a11-4f18-8dbe-fbb82e95f39f", "name": "network-vif-plugged", "status": "completed", "tag": "2a079287-92d9-4c25-bdec-babc0efb1738"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:37:55.263236 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-e7338be8-3bb0-41a3-bdb2-370ae7602e05 req-a3ed7f73-840c-4735-9bf0-6a135e4affdb service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:55.264174 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-e7338be8-3bb0-41a3-bdb2-370ae7602e05 req-a3ed7f73-840c-4735-9bf0-6a135e4affdb service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:55.285663 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-e7338be8-3bb0-41a3-bdb2-370ae7602e05 req-a3ed7f73-840c-4735-9bf0-6a135e4affdb service nova] Creating event network-vif-plugged:2a079287-92d9-4c25-bdec-babc0efb1738 for instance 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f on hv-cinder-84984 Jul 31 18:37:55.292920 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-e7338be8-3bb0-41a3-bdb2-370ae7602e05 req-a3ed7f73-840c-4735-9bf0-6a135e4affdb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049066 Jul 31 18:37:55.293691 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 66/126] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:37:55.561063 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-9e7cc4bc-383f-44b6-92d7-8a8a69111e1d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:55.561693 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-9e7cc4bc-383f-44b6-92d7-8a8a69111e1d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:55.568558 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9e7cc4bc-383f-44b6-92d7-8a8a69111e1d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:55.569581 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9e7cc4bc-383f-44b6-92d7-8a8a69111e1d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:55.571018 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9e7cc4bc-383f-44b6-92d7-8a8a69111e1d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:55.571695 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9e7cc4bc-383f-44b6-92d7-8a8a69111e1d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:55.578554 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-ade1b31d-5755-4003-b70c-4e35666edb77 req-06e09a7e-33e7-49e4-9b3c-dc4c214dc408 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2", "tag": "709b893e-7977-4da7-bda4-449ee074c200"}, {"name": "network-changed", "server_uuid": "f0eb4664-6cc5-455b-909b-ed8a7f69fd8e", "tag": "f31ad60e-e7f8-4d09-9210-49fc69a01236"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:37:55.590887 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-ade1b31d-5755-4003-b70c-4e35666edb77 req-06e09a7e-33e7-49e4-9b3c-dc4c214dc408 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:55.591795 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-ade1b31d-5755-4003-b70c-4e35666edb77 req-06e09a7e-33e7-49e4-9b3c-dc4c214dc408 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:55.606715 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-ade1b31d-5755-4003-b70c-4e35666edb77 req-06e09a7e-33e7-49e4-9b3c-dc4c214dc408 service nova] Creating event network-changed:709b893e-7977-4da7-bda4-449ee074c200 for instance 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 on hv-cinder-84984 Jul 31 18:37:55.607749 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-ade1b31d-5755-4003-b70c-4e35666edb77 req-06e09a7e-33e7-49e4-9b3c-dc4c214dc408 service nova] Creating event network-changed:f31ad60e-e7f8-4d09-9210-49fc69a01236 for instance f0eb4664-6cc5-455b-909b-ed8a7f69fd8e on hv-cinder-84984 Jul 31 18:37:55.631879 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-ade1b31d-5755-4003-b70c-4e35666edb77 req-06e09a7e-33e7-49e4-9b3c-dc4c214dc408 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.060468 Jul 31 18:37:55.635833 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 67/127] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:37:55.648419 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4548eb29-23a2-4bfc-bb33-dd734fc90931 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:55.650514 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-4548eb29-23a2-4bfc-bb33-dd734fc90931 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:55.661844 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4548eb29-23a2-4bfc-bb33-dd734fc90931 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:55.662397 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4548eb29-23a2-4bfc-bb33-dd734fc90931 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:55.663584 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4548eb29-23a2-4bfc-bb33-dd734fc90931 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:55.664090 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4548eb29-23a2-4bfc-bb33-dd734fc90931 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:55.825276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-9e7cc4bc-383f-44b6-92d7-8a8a69111e1d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:55.834747 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-9e7cc4bc-383f-44b6-92d7-8a8a69111e1d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 200 len: 1367 microversion: 2.1 time: 0.278898 Jul 31 18:37:55.835979 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 61/128] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:55 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 1367 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:55.852555 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-4548eb29-23a2-4bfc-bb33-dd734fc90931 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:55.853456 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-c8883a3e-d10e-4e98-aae9-3e0e36de69ad tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:55.854187 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-c8883a3e-d10e-4e98-aae9-3e0e36de69ad tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:55.860949 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-4548eb29-23a2-4bfc-bb33-dd734fc90931 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1363 microversion: 2.1 time: 0.222346 Jul 31 18:37:55.861100 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c8883a3e-d10e-4e98-aae9-3e0e36de69ad tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:55.861394 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c8883a3e-d10e-4e98-aae9-3e0e36de69ad tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:55.861764 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 68/129] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:55 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:55.862563 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c8883a3e-d10e-4e98-aae9-3e0e36de69ad tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:55.862994 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c8883a3e-d10e-4e98-aae9-3e0e36de69ad tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:56.200384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-6f9233fe-fd4d-4175-b69b-5953492919ba tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:56.201781 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-6f9233fe-fd4d-4175-b69b-5953492919ba tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:56.211085 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6f9233fe-fd4d-4175-b69b-5953492919ba tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:56.211838 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6f9233fe-fd4d-4175-b69b-5953492919ba tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:56.213533 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6f9233fe-fd4d-4175-b69b-5953492919ba tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:56.214063 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6f9233fe-fd4d-4175-b69b-5953492919ba tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:56.382103 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-6f9233fe-fd4d-4175-b69b-5953492919ba tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:56.393167 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-6f9233fe-fd4d-4175-b69b-5953492919ba tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1322 microversion: 2.1 time: 0.198390 Jul 31 18:37:56.393167 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 69/130] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:56 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:37:56.396648 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-bde6f001-958c-4392-88d9-33ef02836e69 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:56.397556 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-bde6f001-958c-4392-88d9-33ef02836e69 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:56.403903 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-bde6f001-958c-4392-88d9-33ef02836e69 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:56.404693 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-bde6f001-958c-4392-88d9-33ef02836e69 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:56.405563 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-bde6f001-958c-4392-88d9-33ef02836e69 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:56.406243 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-bde6f001-958c-4392-88d9-33ef02836e69 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:56.566407 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-bde6f001-958c-4392-88d9-33ef02836e69 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e518e5691a7247de9d04ae9828809498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eb8b8a120e4e87b4407d0abb3b3f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:56.577869 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-bde6f001-958c-4392-88d9-33ef02836e69 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 200 len: 1314 microversion: 2.1 time: 0.185515 Jul 31 18:37:56.578658 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 70/131] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:56 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:56.856595 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-00b638e9-7963-406d-a918-3225fbe617ac tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:56.858179 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-00b638e9-7963-406d-a918-3225fbe617ac tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:56.868405 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-00b638e9-7963-406d-a918-3225fbe617ac tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:56.869010 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-00b638e9-7963-406d-a918-3225fbe617ac tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:56.870195 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-00b638e9-7963-406d-a918-3225fbe617ac tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:56.871050 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-00b638e9-7963-406d-a918-3225fbe617ac tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:56.905816 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-c8883a3e-d10e-4e98-aae9-3e0e36de69ad tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:56.920101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-c8883a3e-d10e-4e98-aae9-3e0e36de69ad tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:56.921766 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-c8883a3e-d10e-4e98-aae9-3e0e36de69ad tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:56.922916 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-c8883a3e-d10e-4e98-aae9-3e0e36de69ad tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1407 microversion: 2.20 time: 1.074332 Jul 31 18:37:56.923538 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 62/132] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:37:55 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1407 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:37:56.951923 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-890c10df-4b43-4f4f-81c1-26e91ba9a677 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:56.952569 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-890c10df-4b43-4f4f-81c1-26e91ba9a677 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:56.969050 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-890c10df-4b43-4f4f-81c1-26e91ba9a677 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:56.969807 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-890c10df-4b43-4f4f-81c1-26e91ba9a677 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:56.972791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-890c10df-4b43-4f4f-81c1-26e91ba9a677 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:56.973539 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-890c10df-4b43-4f4f-81c1-26e91ba9a677 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:57.140489 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-00b638e9-7963-406d-a918-3225fbe617ac tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:57.161926 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-00b638e9-7963-406d-a918-3225fbe617ac tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 200 len: 1367 microversion: 2.1 time: 0.308096 Jul 31 18:37:57.162567 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 71/133] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:56 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:37:57.183565 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-890c10df-4b43-4f4f-81c1-26e91ba9a677 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:57.191737 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-890c10df-4b43-4f4f-81c1-26e91ba9a677 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1363 microversion: 2.1 time: 0.247499 Jul 31 18:37:57.205551 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 63/134] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:56 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:57.412578 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-3ecf114f-e173-459b-834c-9014c0352a28 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:57.413472 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-3ecf114f-e173-459b-834c-9014c0352a28 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:57.424107 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3ecf114f-e173-459b-834c-9014c0352a28 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:57.424715 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3ecf114f-e173-459b-834c-9014c0352a28 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:57.426562 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3ecf114f-e173-459b-834c-9014c0352a28 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:57.426951 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3ecf114f-e173-459b-834c-9014c0352a28 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:57.598702 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-3ecf114f-e173-459b-834c-9014c0352a28 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:57.601153 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-5c791d02-9d7a-4b85-8ec6-a8a5a02a1358 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:57.602926 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-5c791d02-9d7a-4b85-8ec6-a8a5a02a1358 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:57.615707 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-3ecf114f-e173-459b-834c-9014c0352a28 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1322 microversion: 2.1 time: 0.206533 Jul 31 18:37:57.616218 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5c791d02-9d7a-4b85-8ec6-a8a5a02a1358 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:57.630076 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5c791d02-9d7a-4b85-8ec6-a8a5a02a1358 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:57.631027 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 72/135] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:57 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:57.632082 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5c791d02-9d7a-4b85-8ec6-a8a5a02a1358 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:57.633498 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5c791d02-9d7a-4b85-8ec6-a8a5a02a1358 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:57.655408 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=100 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:57.947918 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-cae0ddd1-e046-4036-89e1-1ea160502645 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:57.949692 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-cae0ddd1-e046-4036-89e1-1ea160502645 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:57.957082 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cae0ddd1-e046-4036-89e1-1ea160502645 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:57.958183 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cae0ddd1-e046-4036-89e1-1ea160502645 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:57.959258 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cae0ddd1-e046-4036-89e1-1ea160502645 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:57.959964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cae0ddd1-e046-4036-89e1-1ea160502645 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:58.136634 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-cae0ddd1-e046-4036-89e1-1ea160502645 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:58.144804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-cae0ddd1-e046-4036-89e1-1ea160502645 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:58.147302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-cae0ddd1-e046-4036-89e1-1ea160502645 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:58.148428 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-cae0ddd1-e046-4036-89e1-1ea160502645 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1407 microversion: 2.20 time: 0.204860 Jul 31 18:37:58.149353 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 73/136] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:37:57 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:37:58.187977 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-3f675d8f-7612-44e4-ba4c-a1b7b194e0ae tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:58.189292 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-3f675d8f-7612-44e4-ba4c-a1b7b194e0ae tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:58.199825 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3f675d8f-7612-44e4-ba4c-a1b7b194e0ae tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:58.200273 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3f675d8f-7612-44e4-ba4c-a1b7b194e0ae tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:58.201126 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3f675d8f-7612-44e4-ba4c-a1b7b194e0ae tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:58.201572 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3f675d8f-7612-44e4-ba4c-a1b7b194e0ae tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:58.213307 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-5c791d02-9d7a-4b85-8ec6-a8a5a02a1358 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e518e5691a7247de9d04ae9828809498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eb8b8a120e4e87b4407d0abb3b3f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:58.226108 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-5c791d02-9d7a-4b85-8ec6-a8a5a02a1358 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 200 len: 1502 microversion: 2.1 time: 0.627306 Jul 31 18:37:58.241817 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 64/137] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:57 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 1502 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:58.251926 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-da8c6429-06ba-40c4-9cd5-1456d9de1598 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:58.252571 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-da8c6429-06ba-40c4-9cd5-1456d9de1598 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:58.275404 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-da8c6429-06ba-40c4-9cd5-1456d9de1598 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:58.276363 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-da8c6429-06ba-40c4-9cd5-1456d9de1598 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:58.277699 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-da8c6429-06ba-40c4-9cd5-1456d9de1598 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:58.278473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-da8c6429-06ba-40c4-9cd5-1456d9de1598 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:58.459152 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-3f675d8f-7612-44e4-ba4c-a1b7b194e0ae tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:58.464145 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-da8c6429-06ba-40c4-9cd5-1456d9de1598 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:58.472077 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-3f675d8f-7612-44e4-ba4c-a1b7b194e0ae tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 200 len: 1367 microversion: 2.1 time: 0.292087 Jul 31 18:37:58.472983 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-da8c6429-06ba-40c4-9cd5-1456d9de1598 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1363 microversion: 2.1 time: 0.229880 Jul 31 18:37:58.473627 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 65/138] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:58 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:58.474234 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 74/139] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:58 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:37:58.642635 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-4d240e0a-83dc-4061-afe5-91fd13983212 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:58.643626 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-4d240e0a-83dc-4061-afe5-91fd13983212 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:58.661127 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4d240e0a-83dc-4061-afe5-91fd13983212 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:58.665066 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4d240e0a-83dc-4061-afe5-91fd13983212 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:58.670158 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4d240e0a-83dc-4061-afe5-91fd13983212 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:58.677555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4d240e0a-83dc-4061-afe5-91fd13983212 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:58.745320 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell0:SELECT=8 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:37:59.140348 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-7271ff47-0be2-4376-a91d-b5907022d020 req-604b6d59-a708-4c99-8237-970d6dc18d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c", "name": "network-vif-plugged", "status": "completed", "tag": "7bcdc20b-6ddb-46c2-ba36-8f9cc27cf413"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:37:59.169387 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-7271ff47-0be2-4376-a91d-b5907022d020 req-604b6d59-a708-4c99-8237-970d6dc18d4c service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:59.169901 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-7271ff47-0be2-4376-a91d-b5907022d020 req-604b6d59-a708-4c99-8237-970d6dc18d4c service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:59.190888 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-7271ff47-0be2-4376-a91d-b5907022d020 req-604b6d59-a708-4c99-8237-970d6dc18d4c service nova] Creating event network-vif-plugged:7bcdc20b-6ddb-46c2-ba36-8f9cc27cf413 for instance 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c on hv-cinder-84984 Jul 31 18:37:59.197703 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-7271ff47-0be2-4376-a91d-b5907022d020 req-604b6d59-a708-4c99-8237-970d6dc18d4c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061116 Jul 31 18:37:59.199118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 75/140] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:37:59.204787 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-d98ce32a-aa39-4f64-8b56-3e63764ba0e2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:59.205754 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-d98ce32a-aa39-4f64-8b56-3e63764ba0e2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:59.215353 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d98ce32a-aa39-4f64-8b56-3e63764ba0e2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:59.216226 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d98ce32a-aa39-4f64-8b56-3e63764ba0e2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:59.217474 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d98ce32a-aa39-4f64-8b56-3e63764ba0e2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:59.218720 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d98ce32a-aa39-4f64-8b56-3e63764ba0e2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:59.424739 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-d98ce32a-aa39-4f64-8b56-3e63764ba0e2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:59.436162 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-d98ce32a-aa39-4f64-8b56-3e63764ba0e2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:59.437957 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-d98ce32a-aa39-4f64-8b56-3e63764ba0e2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:59.439677 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-d98ce32a-aa39-4f64-8b56-3e63764ba0e2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1599 microversion: 2.20 time: 0.239277 Jul 31 18:37:59.453552 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 76/141] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:37:59 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1599 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:37:59.465118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-63a1b150-62e4-46a6-9dbb-3b03e34c6493 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:59.472973 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-63a1b150-62e4-46a6-9dbb-3b03e34c6493 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:59.484885 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-63a1b150-62e4-46a6-9dbb-3b03e34c6493 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:59.485328 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-63a1b150-62e4-46a6-9dbb-3b03e34c6493 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:59.486111 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-63a1b150-62e4-46a6-9dbb-3b03e34c6493 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:59.486673 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-63a1b150-62e4-46a6-9dbb-3b03e34c6493 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:59.615299 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-63a1b150-62e4-46a6-9dbb-3b03e34c6493 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.154071 Jul 31 18:37:59.617187 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 77/142] 10.222.0.49 () {60 vars in 1316 bytes} [Sun Jul 31 18:37:59 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f/os-interface => generated 285 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 18:37:59.627611 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-ea768214-dbea-40c0-90dc-be8318e45bab tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:59.630354 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-ea768214-dbea-40c0-90dc-be8318e45bab tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:59.644302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ea768214-dbea-40c0-90dc-be8318e45bab tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:59.645242 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ea768214-dbea-40c0-90dc-be8318e45bab tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:59.646767 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ea768214-dbea-40c0-90dc-be8318e45bab tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:59.648308 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ea768214-dbea-40c0-90dc-be8318e45bab tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:59.669711 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-4d240e0a-83dc-4061-afe5-91fd13983212 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:37:59.680112 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-4d240e0a-83dc-4061-afe5-91fd13983212 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1322 microversion: 2.1 time: 1.042499 Jul 31 18:37:59.682097 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 66/143] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:58 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1322 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:37:59.690338 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-7a9ad9da-f031-4044-950e-9aae1be1ddea tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:37:59.691497 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-7a9ad9da-f031-4044-950e-9aae1be1ddea tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:37:59.707624 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7a9ad9da-f031-4044-950e-9aae1be1ddea tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:59.708396 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7a9ad9da-f031-4044-950e-9aae1be1ddea tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:37:59.709707 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7a9ad9da-f031-4044-950e-9aae1be1ddea tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:37:59.710149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7a9ad9da-f031-4044-950e-9aae1be1ddea tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:00.043194 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-ea768214-dbea-40c0-90dc-be8318e45bab tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:00.053019 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-ea768214-dbea-40c0-90dc-be8318e45bab tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 200 len: 1367 microversion: 2.1 time: 0.431531 Jul 31 18:38:00.053595 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 78/144] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:59 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 1367 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:00.061848 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-a1ca7e72-9341-4709-bf61-1b7ffdce23a2 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d111d6b-1674-4734-b244-5bf7c562e4a4"}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:38:00.067851 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-a1ca7e72-9341-4709-bf61-1b7ffdce23a2 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:00.076537 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a1ca7e72-9341-4709-bf61-1b7ffdce23a2 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:00.077242 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a1ca7e72-9341-4709-bf61-1b7ffdce23a2 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:00.078129 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a1ca7e72-9341-4709-bf61-1b7ffdce23a2 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:00.078575 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a1ca7e72-9341-4709-bf61-1b7ffdce23a2 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:00.095757 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-7a9ad9da-f031-4044-950e-9aae1be1ddea tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:00.109892 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-7a9ad9da-f031-4044-950e-9aae1be1ddea tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1363 microversion: 2.1 time: 0.425769 Jul 31 18:38:00.112020 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 67/145] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:37:59 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1363 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:00.665363 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-a1ca7e72-9341-4709-bf61-1b7ffdce23a2 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "POST /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.606924 Jul 31 18:38:00.667499 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 79/146] 10.222.0.49 () {60 vars in 1323 bytes} [Sun Jul 31 18:38:00 2022] POST /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386/os-volume_attachments => generated 194 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:38:00.701427 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-86e872ff-11d6-42de-b764-4bbdcaa74f08 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:00.702658 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-86e872ff-11d6-42de-b764-4bbdcaa74f08 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:00.713959 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-86e872ff-11d6-42de-b764-4bbdcaa74f08 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:00.714673 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-86e872ff-11d6-42de-b764-4bbdcaa74f08 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:00.715612 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-86e872ff-11d6-42de-b764-4bbdcaa74f08 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:00.716235 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-86e872ff-11d6-42de-b764-4bbdcaa74f08 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:00.911055 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-86e872ff-11d6-42de-b764-4bbdcaa74f08 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:00.921672 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-86e872ff-11d6-42de-b764-4bbdcaa74f08 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1322 microversion: 2.1 time: 0.224221 Jul 31 18:38:00.922323 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 68/147] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:00 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:01.074850 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-3e765146-5c0c-4c5e-b4ea-e7c94637347b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:01.075769 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-3e765146-5c0c-4c5e-b4ea-e7c94637347b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:01.088801 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3e765146-5c0c-4c5e-b4ea-e7c94637347b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:01.095406 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3e765146-5c0c-4c5e-b4ea-e7c94637347b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:01.101783 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3e765146-5c0c-4c5e-b4ea-e7c94637347b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:01.102244 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3e765146-5c0c-4c5e-b4ea-e7c94637347b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:01.132163 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-216291d6-1d29-4775-b7a6-56fae41e6216 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:01.132954 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-216291d6-1d29-4775-b7a6-56fae41e6216 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:01.142546 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-216291d6-1d29-4775-b7a6-56fae41e6216 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:01.145410 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-216291d6-1d29-4775-b7a6-56fae41e6216 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:01.146404 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-216291d6-1d29-4775-b7a6-56fae41e6216 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:01.148882 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-216291d6-1d29-4775-b7a6-56fae41e6216 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:01.426951 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-216291d6-1d29-4775-b7a6-56fae41e6216 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:01.435594 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-216291d6-1d29-4775-b7a6-56fae41e6216 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1363 microversion: 2.1 time: 0.308275 Jul 31 18:38:01.436588 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 69/148] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:01 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1363 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:01.447102 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-3e765146-5c0c-4c5e-b4ea-e7c94637347b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:01.456114 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-3e765146-5c0c-4c5e-b4ea-e7c94637347b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 200 len: 1367 microversion: 2.1 time: 0.385725 Jul 31 18:38:01.457156 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 80/149] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:01 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 1367 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:01.884592 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-7134854a-76a7-4bb8-9e66-8d4c4c76ed38 req-cf2b26ab-2efb-4646-a240-720c75699949 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "432e6c6a-9a11-4f18-8dbe-fbb82e95f39f", "tag": "2a079287-92d9-4c25-bdec-babc0efb1738"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:38:01.897485 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-7134854a-76a7-4bb8-9e66-8d4c4c76ed38 req-cf2b26ab-2efb-4646-a240-720c75699949 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:01.898132 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-7134854a-76a7-4bb8-9e66-8d4c4c76ed38 req-cf2b26ab-2efb-4646-a240-720c75699949 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:01.914159 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-7134854a-76a7-4bb8-9e66-8d4c4c76ed38 req-cf2b26ab-2efb-4646-a240-720c75699949 service nova] Creating event network-changed:2a079287-92d9-4c25-bdec-babc0efb1738 for instance 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f on hv-cinder-84984 Jul 31 18:38:01.919733 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-7134854a-76a7-4bb8-9e66-8d4c4c76ed38 req-cf2b26ab-2efb-4646-a240-720c75699949 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039870 Jul 31 18:38:01.924841 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 70/150] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:38:01.943992 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-7e13f121-9374-4600-beec-12ccfb86ab1e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:01.945321 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-7e13f121-9374-4600-beec-12ccfb86ab1e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:01.952442 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7e13f121-9374-4600-beec-12ccfb86ab1e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:01.952996 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7e13f121-9374-4600-beec-12ccfb86ab1e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:01.953877 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7e13f121-9374-4600-beec-12ccfb86ab1e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:01.954505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7e13f121-9374-4600-beec-12ccfb86ab1e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:01.975351 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:02.132486 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-7e13f121-9374-4600-beec-12ccfb86ab1e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:02.141040 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-7e13f121-9374-4600-beec-12ccfb86ab1e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1322 microversion: 2.1 time: 0.201822 Jul 31 18:38:02.154206 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 81/151] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:01 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:02.458121 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-6f7868e6-e3ac-4f71-829f-c5a158d8221f tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:02.459045 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-6f7868e6-e3ac-4f71-829f-c5a158d8221f tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:02.476085 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6f7868e6-e3ac-4f71-829f-c5a158d8221f tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:02.476752 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6f7868e6-e3ac-4f71-829f-c5a158d8221f tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:02.479012 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4e4b2b85-8a6e-4d8f-839a-d0d1f00751f2 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:02.479634 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-4e4b2b85-8a6e-4d8f-839a-d0d1f00751f2 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:02.481892 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6f7868e6-e3ac-4f71-829f-c5a158d8221f tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:02.484644 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6f7868e6-e3ac-4f71-829f-c5a158d8221f tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:02.488115 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4e4b2b85-8a6e-4d8f-839a-d0d1f00751f2 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:02.490854 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4e4b2b85-8a6e-4d8f-839a-d0d1f00751f2 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:02.491656 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4e4b2b85-8a6e-4d8f-839a-d0d1f00751f2 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:02.493305 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4e4b2b85-8a6e-4d8f-839a-d0d1f00751f2 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:02.699601 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-4e4b2b85-8a6e-4d8f-839a-d0d1f00751f2 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:02.708590 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-4e4b2b85-8a6e-4d8f-839a-d0d1f00751f2 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 200 len: 1367 microversion: 2.1 time: 0.235412 Jul 31 18:38:02.709256 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 82/152] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:02 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:38:02.747595 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-6f7868e6-e3ac-4f71-829f-c5a158d8221f tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:02.758062 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-6f7868e6-e3ac-4f71-829f-c5a158d8221f tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1363 microversion: 2.1 time: 0.304592 Jul 31 18:38:02.758921 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 71/153] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:02 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1363 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:03.164405 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-69f85cc4-acbc-40ca-b948-94ebfae2b58d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:03.165785 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-69f85cc4-acbc-40ca-b948-94ebfae2b58d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:03.177532 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-69f85cc4-acbc-40ca-b948-94ebfae2b58d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:03.180017 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-69f85cc4-acbc-40ca-b948-94ebfae2b58d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:03.181051 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-69f85cc4-acbc-40ca-b948-94ebfae2b58d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:03.182460 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-69f85cc4-acbc-40ca-b948-94ebfae2b58d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:03.427417 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-593992e3-c058-469d-8a91-2199f3e700d1 req-9c6d0cd9-37fc-47c3-a3e5-548fe513dfce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0eb4664-6cc5-455b-909b-ed8a7f69fd8e", "name": "network-vif-plugged", "status": "completed", "tag": "f31ad60e-e7f8-4d09-9210-49fc69a01236"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:38:03.446612 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-593992e3-c058-469d-8a91-2199f3e700d1 req-9c6d0cd9-37fc-47c3-a3e5-548fe513dfce service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:03.447600 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-593992e3-c058-469d-8a91-2199f3e700d1 req-9c6d0cd9-37fc-47c3-a3e5-548fe513dfce service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:03.462509 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-593992e3-c058-469d-8a91-2199f3e700d1 req-9c6d0cd9-37fc-47c3-a3e5-548fe513dfce service nova] Creating event network-vif-plugged:f31ad60e-e7f8-4d09-9210-49fc69a01236 for instance f0eb4664-6cc5-455b-909b-ed8a7f69fd8e on hv-cinder-84984 Jul 31 18:38:03.469564 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-593992e3-c058-469d-8a91-2199f3e700d1 req-9c6d0cd9-37fc-47c3-a3e5-548fe513dfce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049984 Jul 31 18:38:03.470756 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 72/154] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:38:03.481993 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-69f85cc4-acbc-40ca-b948-94ebfae2b58d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:03.494120 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-69f85cc4-acbc-40ca-b948-94ebfae2b58d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1322 microversion: 2.1 time: 0.333737 Jul 31 18:38:03.495470 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 83/155] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:03 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:03.736066 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-36ed91fb-34f5-4df4-9c3f-976cca2b90aa tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:03.736803 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-36ed91fb-34f5-4df4-9c3f-976cca2b90aa tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:03.756893 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-36ed91fb-34f5-4df4-9c3f-976cca2b90aa tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:03.757344 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-36ed91fb-34f5-4df4-9c3f-976cca2b90aa tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:03.758112 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-36ed91fb-34f5-4df4-9c3f-976cca2b90aa tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:03.758545 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-36ed91fb-34f5-4df4-9c3f-976cca2b90aa tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:03.780092 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-05094b37-7933-43b9-9274-28b5ef067067 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:03.780976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-05094b37-7933-43b9-9274-28b5ef067067 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:03.787497 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-05094b37-7933-43b9-9274-28b5ef067067 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:03.788098 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-05094b37-7933-43b9-9274-28b5ef067067 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:03.789041 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-05094b37-7933-43b9-9274-28b5ef067067 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:03.789607 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-05094b37-7933-43b9-9274-28b5ef067067 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:04.047400 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-05094b37-7933-43b9-9274-28b5ef067067 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:04.057227 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-05094b37-7933-43b9-9274-28b5ef067067 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1363 microversion: 2.1 time: 0.281619 Jul 31 18:38:04.073142 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 84/156] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:03 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1363 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:38:04.517349 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-545d146a-7705-470e-99d3-b4425a9adbd0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:04.518791 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-545d146a-7705-470e-99d3-b4425a9adbd0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:04.529089 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-545d146a-7705-470e-99d3-b4425a9adbd0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:04.534746 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-545d146a-7705-470e-99d3-b4425a9adbd0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:04.535592 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-545d146a-7705-470e-99d3-b4425a9adbd0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:04.536028 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-545d146a-7705-470e-99d3-b4425a9adbd0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:04.765243 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-545d146a-7705-470e-99d3-b4425a9adbd0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:04.774088 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-545d146a-7705-470e-99d3-b4425a9adbd0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1322 microversion: 2.1 time: 0.261818 Jul 31 18:38:04.774846 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 85/157] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:04 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:04.908636 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-36ed91fb-34f5-4df4-9c3f-976cca2b90aa tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:04.919937 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-36ed91fb-34f5-4df4-9c3f-976cca2b90aa tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 200 len: 1367 microversion: 2.1 time: 1.192314 Jul 31 18:38:04.935388 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 73/158] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:03 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 1367 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:05.081224 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-29318053-63db-43b5-a2e6-89fca7217da7 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:05.082265 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-29318053-63db-43b5-a2e6-89fca7217da7 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:05.088419 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-29318053-63db-43b5-a2e6-89fca7217da7 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:05.089050 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-29318053-63db-43b5-a2e6-89fca7217da7 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:05.089950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-29318053-63db-43b5-a2e6-89fca7217da7 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:05.090527 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-29318053-63db-43b5-a2e6-89fca7217da7 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:05.282648 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-29318053-63db-43b5-a2e6-89fca7217da7 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:05.294603 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-29318053-63db-43b5-a2e6-89fca7217da7 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1363 microversion: 2.1 time: 0.218281 Jul 31 18:38:05.295293 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 86/159] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:05 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:05.488277 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-1a01c1e1-f873-46ef-9fc5-0bf90428d4e4 req-c3cb60f5-81d3-448f-ab3c-529df0cacc55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1577f8a-0f79-4b82-9afa-85c86f07cf92", "name": "network-vif-plugged", "status": "completed", "tag": "afbd6a66-843d-4087-b7a7-1be3dd6e4af4"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:38:05.497872 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-1a01c1e1-f873-46ef-9fc5-0bf90428d4e4 req-c3cb60f5-81d3-448f-ab3c-529df0cacc55 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:05.498316 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-1a01c1e1-f873-46ef-9fc5-0bf90428d4e4 req-c3cb60f5-81d3-448f-ab3c-529df0cacc55 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:05.519635 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-1a01c1e1-f873-46ef-9fc5-0bf90428d4e4 req-c3cb60f5-81d3-448f-ab3c-529df0cacc55 service nova] Creating event network-vif-plugged:afbd6a66-843d-4087-b7a7-1be3dd6e4af4 for instance a1577f8a-0f79-4b82-9afa-85c86f07cf92 on hv-cinder-84984 Jul 31 18:38:05.524937 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-1a01c1e1-f873-46ef-9fc5-0bf90428d4e4 req-c3cb60f5-81d3-448f-ab3c-529df0cacc55 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040203 Jul 31 18:38:05.525868 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 74/160] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:38:05.795090 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-ccd15814-4840-40aa-a3fd-f7ceaf4dabd1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:05.795695 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-ccd15814-4840-40aa-a3fd-f7ceaf4dabd1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:05.807639 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ccd15814-4840-40aa-a3fd-f7ceaf4dabd1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:05.808271 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ccd15814-4840-40aa-a3fd-f7ceaf4dabd1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:05.809279 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ccd15814-4840-40aa-a3fd-f7ceaf4dabd1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:05.809949 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ccd15814-4840-40aa-a3fd-f7ceaf4dabd1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:05.953908 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-c1ca7a2f-35e3-48ff-a5a4-9ef9ad89be82 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:05.955943 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-c1ca7a2f-35e3-48ff-a5a4-9ef9ad89be82 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:05.972667 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c1ca7a2f-35e3-48ff-a5a4-9ef9ad89be82 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:05.973611 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c1ca7a2f-35e3-48ff-a5a4-9ef9ad89be82 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:05.975068 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c1ca7a2f-35e3-48ff-a5a4-9ef9ad89be82 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:05.976238 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c1ca7a2f-35e3-48ff-a5a4-9ef9ad89be82 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:06.057846 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-ccd15814-4840-40aa-a3fd-f7ceaf4dabd1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:06.065883 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-ccd15814-4840-40aa-a3fd-f7ceaf4dabd1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1322 microversion: 2.1 time: 0.274637 Jul 31 18:38:06.066686 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 87/161] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:05 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:06.215469 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-c1ca7a2f-35e3-48ff-a5a4-9ef9ad89be82 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:06.224546 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-c1ca7a2f-35e3-48ff-a5a4-9ef9ad89be82 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 200 len: 1367 microversion: 2.1 time: 0.282348 Jul 31 18:38:06.225618 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 75/162] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:05 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:06.317973 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-a74a7412-b342-4f8e-9ebe-3972b839a5c4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:06.318681 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-a74a7412-b342-4f8e-9ebe-3972b839a5c4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:06.325201 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a74a7412-b342-4f8e-9ebe-3972b839a5c4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:06.325947 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a74a7412-b342-4f8e-9ebe-3972b839a5c4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:06.327536 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a74a7412-b342-4f8e-9ebe-3972b839a5c4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:06.328329 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a74a7412-b342-4f8e-9ebe-3972b839a5c4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:06.470340 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-a74a7412-b342-4f8e-9ebe-3972b839a5c4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:06.478421 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-a74a7412-b342-4f8e-9ebe-3972b839a5c4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1363 microversion: 2.1 time: 0.164209 Jul 31 18:38:06.479279 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 88/163] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:06 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:07.087401 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-5c0432e0-f36a-483c-8adc-9dd4a8d98c8d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:07.088097 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-5c0432e0-f36a-483c-8adc-9dd4a8d98c8d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:07.094942 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5c0432e0-f36a-483c-8adc-9dd4a8d98c8d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:07.095395 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5c0432e0-f36a-483c-8adc-9dd4a8d98c8d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:07.096479 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5c0432e0-f36a-483c-8adc-9dd4a8d98c8d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:07.097204 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5c0432e0-f36a-483c-8adc-9dd4a8d98c8d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:07.249417 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-0301f397-2165-4504-8331-2eee42c4af04 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:07.250457 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-0301f397-2165-4504-8331-2eee42c4af04 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:07.260522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0301f397-2165-4504-8331-2eee42c4af04 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:07.261216 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0301f397-2165-4504-8331-2eee42c4af04 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:07.262491 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0301f397-2165-4504-8331-2eee42c4af04 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:07.263197 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0301f397-2165-4504-8331-2eee42c4af04 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:07.268571 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-5c0432e0-f36a-483c-8adc-9dd4a8d98c8d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:07.276654 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-5c0432e0-f36a-483c-8adc-9dd4a8d98c8d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1322 microversion: 2.1 time: 0.193268 Jul 31 18:38:07.277775 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 76/164] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:07 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:07.465933 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-0301f397-2165-4504-8331-2eee42c4af04 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:07.475388 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-0301f397-2165-4504-8331-2eee42c4af04 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 200 len: 1367 microversion: 2.1 time: 0.230936 Jul 31 18:38:07.476239 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 89/165] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:07 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:07.499307 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-5a523b77-3367-4990-9f82-ca0785a97a4d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:07.499912 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-5a523b77-3367-4990-9f82-ca0785a97a4d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:07.507287 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5a523b77-3367-4990-9f82-ca0785a97a4d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:07.508551 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5a523b77-3367-4990-9f82-ca0785a97a4d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:07.509895 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5a523b77-3367-4990-9f82-ca0785a97a4d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:07.510475 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5a523b77-3367-4990-9f82-ca0785a97a4d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:07.540504 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-f5c17fde-6d4c-44b7-932b-5b537aa210d1 req-0e1921d4-3d45-4a23-b927-7b6b8fe3e05e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2", "name": "network-vif-plugged", "status": "completed", "tag": "709b893e-7977-4da7-bda4-449ee074c200"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:38:07.553225 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-f5c17fde-6d4c-44b7-932b-5b537aa210d1 req-0e1921d4-3d45-4a23-b927-7b6b8fe3e05e service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:07.553665 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-f5c17fde-6d4c-44b7-932b-5b537aa210d1 req-0e1921d4-3d45-4a23-b927-7b6b8fe3e05e service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:07.573566 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-f5c17fde-6d4c-44b7-932b-5b537aa210d1 req-0e1921d4-3d45-4a23-b927-7b6b8fe3e05e service nova] Creating event network-vif-plugged:709b893e-7977-4da7-bda4-449ee074c200 for instance 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 on hv-cinder-84984 Jul 31 18:38:07.582629 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-f5c17fde-6d4c-44b7-932b-5b537aa210d1 req-0e1921d4-3d45-4a23-b927-7b6b8fe3e05e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045810 Jul 31 18:38:07.589546 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 90/166] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:38:07.661220 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-5a523b77-3367-4990-9f82-ca0785a97a4d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:07.671670 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-5a523b77-3367-4990-9f82-ca0785a97a4d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1363 microversion: 2.1 time: 0.176555 Jul 31 18:38:07.672410 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 77/167] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:07 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:08.300669 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-344818d9-bf3d-4d97-90e1-15105d681593 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:08.301392 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-344818d9-bf3d-4d97-90e1-15105d681593 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:08.307926 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-344818d9-bf3d-4d97-90e1-15105d681593 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:08.308368 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-344818d9-bf3d-4d97-90e1-15105d681593 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:08.309248 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-344818d9-bf3d-4d97-90e1-15105d681593 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:08.309680 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-344818d9-bf3d-4d97-90e1-15105d681593 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:08.454969 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-344818d9-bf3d-4d97-90e1-15105d681593 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:08.462782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-344818d9-bf3d-4d97-90e1-15105d681593 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1322 microversion: 2.1 time: 0.166779 Jul 31 18:38:08.463354 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 91/168] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:08 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:08.496392 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-d6ab142f-c5b8-4799-bb1b-6ccb58c35c7a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:08.497093 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-d6ab142f-c5b8-4799-bb1b-6ccb58c35c7a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:08.504502 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d6ab142f-c5b8-4799-bb1b-6ccb58c35c7a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:08.505112 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d6ab142f-c5b8-4799-bb1b-6ccb58c35c7a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:08.505892 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d6ab142f-c5b8-4799-bb1b-6ccb58c35c7a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:08.506322 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d6ab142f-c5b8-4799-bb1b-6ccb58c35c7a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:08.666787 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-d6ab142f-c5b8-4799-bb1b-6ccb58c35c7a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:08.679067 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-d6ab142f-c5b8-4799-bb1b-6ccb58c35c7a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 200 len: 1558 microversion: 2.1 time: 0.185086 Jul 31 18:38:08.679936 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 78/169] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:08 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 1558 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:08.693905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-92aeb9b4-238a-4ab8-8a4d-4846bee82716 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:08.694526 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-92aeb9b4-238a-4ab8-8a4d-4846bee82716 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:08.703787 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-92aeb9b4-238a-4ab8-8a4d-4846bee82716 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:08.707346 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-92aeb9b4-238a-4ab8-8a4d-4846bee82716 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:08.708407 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-92aeb9b4-238a-4ab8-8a4d-4846bee82716 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:08.710162 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-92aeb9b4-238a-4ab8-8a4d-4846bee82716 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:08.712370 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-f030f8c6-4dc8-43ee-826f-381d2c07fdb7 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:08.713091 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-f030f8c6-4dc8-43ee-826f-381d2c07fdb7 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:08.722561 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f030f8c6-4dc8-43ee-826f-381d2c07fdb7 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:08.723172 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f030f8c6-4dc8-43ee-826f-381d2c07fdb7 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:08.724205 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f030f8c6-4dc8-43ee-826f-381d2c07fdb7 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:08.724629 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f030f8c6-4dc8-43ee-826f-381d2c07fdb7 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:08.853674 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-92aeb9b4-238a-4ab8-8a4d-4846bee82716 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:08.857362 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-f030f8c6-4dc8-43ee-826f-381d2c07fdb7 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.148130 Jul 31 18:38:08.864389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 79/170] 10.222.0.49 () {58 vars in 1275 bytes} [Sun Jul 31 18:38:08 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e/os-interface => generated 285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:38:08.864558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-92aeb9b4-238a-4ab8-8a4d-4846bee82716 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1363 microversion: 2.1 time: 0.173455 Jul 31 18:38:08.864558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 92/171] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:08 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:09.486195 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-0d4d02ea-61e8-4761-a328-6f8c335896eb tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:09.486796 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-0d4d02ea-61e8-4761-a328-6f8c335896eb tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:09.493028 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0d4d02ea-61e8-4761-a328-6f8c335896eb tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:09.493468 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0d4d02ea-61e8-4761-a328-6f8c335896eb tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:09.494224 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0d4d02ea-61e8-4761-a328-6f8c335896eb tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:09.494675 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0d4d02ea-61e8-4761-a328-6f8c335896eb tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:09.671218 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-0d4d02ea-61e8-4761-a328-6f8c335896eb tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:09.681461 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-0d4d02ea-61e8-4761-a328-6f8c335896eb tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1322 microversion: 2.1 time: 0.199170 Jul 31 18:38:09.682048 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 80/172] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:09 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:09.889698 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-ea59e0df-20c7-4dcc-9ead-b9d2f09dff04 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:09.895850 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-ea59e0df-20c7-4dcc-9ead-b9d2f09dff04 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:09.913282 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ea59e0df-20c7-4dcc-9ead-b9d2f09dff04 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:09.914831 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ea59e0df-20c7-4dcc-9ead-b9d2f09dff04 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:09.915973 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ea59e0df-20c7-4dcc-9ead-b9d2f09dff04 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:09.917624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ea59e0df-20c7-4dcc-9ead-b9d2f09dff04 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:10.152597 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-7e13c8b9-6d99-4d02-ba9d-9c34b847079e req-88412008-8000-4db6-b56f-c2653a49b291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0eb4664-6cc5-455b-909b-ed8a7f69fd8e", "tag": "f31ad60e-e7f8-4d09-9210-49fc69a01236"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:38:10.158120 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=95 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:10.167476 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-ea59e0df-20c7-4dcc-9ead-b9d2f09dff04 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:10.168790 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-7e13c8b9-6d99-4d02-ba9d-9c34b847079e req-88412008-8000-4db6-b56f-c2653a49b291 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:10.170134 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-7e13c8b9-6d99-4d02-ba9d-9c34b847079e req-88412008-8000-4db6-b56f-c2653a49b291 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:10.175277 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-ea59e0df-20c7-4dcc-9ead-b9d2f09dff04 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1549 microversion: 2.1 time: 0.294785 Jul 31 18:38:10.185280 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 93/173] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:09 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1549 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:10.187691 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-7e13c8b9-6d99-4d02-ba9d-9c34b847079e req-88412008-8000-4db6-b56f-c2653a49b291 service nova] Creating event network-changed:f31ad60e-e7f8-4d09-9210-49fc69a01236 for instance f0eb4664-6cc5-455b-909b-ed8a7f69fd8e on hv-cinder-84984 Jul 31 18:38:10.199433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-7e13c8b9-6d99-4d02-ba9d-9c34b847079e req-88412008-8000-4db6-b56f-c2653a49b291 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051827 Jul 31 18:38:10.200210 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 81/174] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:38:10.204959 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-419aa338-f221-4c0b-ac9c-e962ea7d05d4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:10.205520 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-419aa338-f221-4c0b-ac9c-e962ea7d05d4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:10.211691 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-419aa338-f221-4c0b-ac9c-e962ea7d05d4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:10.212141 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-419aa338-f221-4c0b-ac9c-e962ea7d05d4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:10.212944 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-419aa338-f221-4c0b-ac9c-e962ea7d05d4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:10.213545 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-419aa338-f221-4c0b-ac9c-e962ea7d05d4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:10.304574 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-419aa338-f221-4c0b-ac9c-e962ea7d05d4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107547 Jul 31 18:38:10.312287 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 94/175] 10.222.0.49 () {58 vars in 1275 bytes} [Sun Jul 31 18:38:10 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:38:10.704276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-5a59362d-f9fc-4e28-bc3c-8602a9e3fc17 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:10.709277 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-5a59362d-f9fc-4e28-bc3c-8602a9e3fc17 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:10.719424 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5a59362d-f9fc-4e28-bc3c-8602a9e3fc17 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:10.721863 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5a59362d-f9fc-4e28-bc3c-8602a9e3fc17 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:10.722970 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5a59362d-f9fc-4e28-bc3c-8602a9e3fc17 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:10.724213 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5a59362d-f9fc-4e28-bc3c-8602a9e3fc17 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:10.938624 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-5a59362d-f9fc-4e28-bc3c-8602a9e3fc17 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:10.953164 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-5a59362d-f9fc-4e28-bc3c-8602a9e3fc17 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1322 microversion: 2.1 time: 0.253069 Jul 31 18:38:10.954635 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 82/176] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:10 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:11.977568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-2e06d780-1fba-48e3-a363-d8410bb73e7d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:11.978591 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-2e06d780-1fba-48e3-a363-d8410bb73e7d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:11.991041 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2e06d780-1fba-48e3-a363-d8410bb73e7d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:11.992234 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2e06d780-1fba-48e3-a363-d8410bb73e7d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:11.993980 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2e06d780-1fba-48e3-a363-d8410bb73e7d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:11.999000 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2e06d780-1fba-48e3-a363-d8410bb73e7d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:12.196794 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-2e06d780-1fba-48e3-a363-d8410bb73e7d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:12.206956 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-2e06d780-1fba-48e3-a363-d8410bb73e7d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1322 microversion: 2.1 time: 0.234061 Jul 31 18:38:12.209088 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 95/177] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:11 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:12.228915 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-03957693-f3f2-4ef6-a2a6-dfc5d514562b req-6e85318d-14b2-4ef2-bcaf-08ec2f2a9330 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1577f8a-0f79-4b82-9afa-85c86f07cf92", "tag": "afbd6a66-843d-4087-b7a7-1be3dd6e4af4"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:38:12.246520 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-03957693-f3f2-4ef6-a2a6-dfc5d514562b req-6e85318d-14b2-4ef2-bcaf-08ec2f2a9330 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:12.247309 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-03957693-f3f2-4ef6-a2a6-dfc5d514562b req-6e85318d-14b2-4ef2-bcaf-08ec2f2a9330 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:12.262400 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-03957693-f3f2-4ef6-a2a6-dfc5d514562b req-6e85318d-14b2-4ef2-bcaf-08ec2f2a9330 service nova] Creating event network-changed:afbd6a66-843d-4087-b7a7-1be3dd6e4af4 for instance a1577f8a-0f79-4b82-9afa-85c86f07cf92 on hv-cinder-84984 Jul 31 18:38:12.268615 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-03957693-f3f2-4ef6-a2a6-dfc5d514562b req-6e85318d-14b2-4ef2-bcaf-08ec2f2a9330 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043612 Jul 31 18:38:12.270021 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 83/178] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:38:13.231564 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-20bb09a0-8415-4e69-9dfa-87abeb9e5758 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:13.232362 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-20bb09a0-8415-4e69-9dfa-87abeb9e5758 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:13.238990 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-20bb09a0-8415-4e69-9dfa-87abeb9e5758 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:13.239622 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-20bb09a0-8415-4e69-9dfa-87abeb9e5758 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:13.240392 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-20bb09a0-8415-4e69-9dfa-87abeb9e5758 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:13.240860 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-20bb09a0-8415-4e69-9dfa-87abeb9e5758 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:13.448133 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-20bb09a0-8415-4e69-9dfa-87abeb9e5758 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:13.461209 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-20bb09a0-8415-4e69-9dfa-87abeb9e5758 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1516 microversion: 2.1 time: 0.233334 Jul 31 18:38:13.461787 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 96/179] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:13 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1516 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:13.496953 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-046e1485-3937-4ce6-9933-855e59d5d157 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:38:13.502158 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-046e1485-3937-4ce6-9933-855e59d5d157 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:13.520033 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-046e1485-3937-4ce6-9933-855e59d5d157 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:13.521868 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-046e1485-3937-4ce6-9933-855e59d5d157 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:13.522799 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-046e1485-3937-4ce6-9933-855e59d5d157 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:13.523306 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-046e1485-3937-4ce6-9933-855e59d5d157 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:13.546987 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=100 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:13.561857 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.objects.instance [None req-046e1485-3937-4ce6-9933-855e59d5d157 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lazy-loading 'flavor' on Instance uuid 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 {{(pid=124333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:38:13.739953 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-046e1485-3937-4ce6-9933-855e59d5d157 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "POST /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2/action" status: 200 len: 32 microversion: 2.1 time: 0.252073 Jul 31 18:38:13.740647 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 84/180] 10.222.0.49 () {60 vars in 1278 bytes} [Sun Jul 31 18:38:13 2022] POST /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2/action => generated 32 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 18:38:13.751817 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-2dae3968-e71d-40c7-aba0-baf1b2c8ab2c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:13.753360 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-2dae3968-e71d-40c7-aba0-baf1b2c8ab2c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:13.762814 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2dae3968-e71d-40c7-aba0-baf1b2c8ab2c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:13.764332 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2dae3968-e71d-40c7-aba0-baf1b2c8ab2c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:13.765407 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2dae3968-e71d-40c7-aba0-baf1b2c8ab2c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:13.766009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2dae3968-e71d-40c7-aba0-baf1b2c8ab2c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:13.981990 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-2dae3968-e71d-40c7-aba0-baf1b2c8ab2c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:13.992446 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-2dae3968-e71d-40c7-aba0-baf1b2c8ab2c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.245768 Jul 31 18:38:13.993321 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 97/181] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:13 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:14.221530 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-55e55785-7fda-4ebb-8cbe-c67d48bfae68 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:14.222472 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-55e55785-7fda-4ebb-8cbe-c67d48bfae68 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:14.242364 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-55e55785-7fda-4ebb-8cbe-c67d48bfae68 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:14.242854 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-55e55785-7fda-4ebb-8cbe-c67d48bfae68 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:14.243692 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-55e55785-7fda-4ebb-8cbe-c67d48bfae68 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:14.244274 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-55e55785-7fda-4ebb-8cbe-c67d48bfae68 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:14.291153 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-55e55785-7fda-4ebb-8cbe-c67d48bfae68 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Going to try to terminate instance {{(pid=124333) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 18:38:14.448066 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-55e55785-7fda-4ebb-8cbe-c67d48bfae68 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 204 len: 0 microversion: 2.1 time: 0.230928 Jul 31 18:38:14.448928 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 85/182] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:38:14 2022] DELETE /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 18:38:14.462477 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-db275931-431e-4f4b-b99d-afba4441078e tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:14.463380 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-db275931-431e-4f4b-b99d-afba4441078e tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:14.477940 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-db275931-431e-4f4b-b99d-afba4441078e tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:14.479203 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-db275931-431e-4f4b-b99d-afba4441078e tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:14.480182 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-db275931-431e-4f4b-b99d-afba4441078e tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:14.483948 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-db275931-431e-4f4b-b99d-afba4441078e tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:14.679027 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-db275931-431e-4f4b-b99d-afba4441078e tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e518e5691a7247de9d04ae9828809498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eb8b8a120e4e87b4407d0abb3b3f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:14.687742 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-db275931-431e-4f4b-b99d-afba4441078e tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 200 len: 1554 microversion: 2.1 time: 0.234216 Jul 31 18:38:14.688680 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 98/183] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:14 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 1554 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:15.017263 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-becd5ffc-a037-4d2d-a352-255c54ce0104 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:15.017966 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-becd5ffc-a037-4d2d-a352-255c54ce0104 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:15.028420 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-becd5ffc-a037-4d2d-a352-255c54ce0104 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:15.028902 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-becd5ffc-a037-4d2d-a352-255c54ce0104 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:15.029886 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-becd5ffc-a037-4d2d-a352-255c54ce0104 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:15.030592 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-becd5ffc-a037-4d2d-a352-255c54ce0104 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:15.205668 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-becd5ffc-a037-4d2d-a352-255c54ce0104 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:15.213685 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-becd5ffc-a037-4d2d-a352-255c54ce0104 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.203506 Jul 31 18:38:15.214256 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 86/184] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:15 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:15.709792 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4770054a-cf9c-4ae1-9e7c-e378b0f50366 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:15.710448 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-4770054a-cf9c-4ae1-9e7c-e378b0f50366 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:15.719155 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=100 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:15.722344 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4770054a-cf9c-4ae1-9e7c-e378b0f50366 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:15.722966 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4770054a-cf9c-4ae1-9e7c-e378b0f50366 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:15.724419 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4770054a-cf9c-4ae1-9e7c-e378b0f50366 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:15.725049 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4770054a-cf9c-4ae1-9e7c-e378b0f50366 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:15.731234 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=100 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:15.925165 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-4770054a-cf9c-4ae1-9e7c-e378b0f50366 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e518e5691a7247de9d04ae9828809498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eb8b8a120e4e87b4407d0abb3b3f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:15.933248 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-4770054a-cf9c-4ae1-9e7c-e378b0f50366 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 200 len: 1554 microversion: 2.1 time: 0.227847 Jul 31 18:38:15.933828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 99/185] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:15 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 1554 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:16.236697 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-dff177d0-cd19-4557-831f-504a5d6a695f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:16.237428 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-dff177d0-cd19-4557-831f-504a5d6a695f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:16.250363 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-dff177d0-cd19-4557-831f-504a5d6a695f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:16.251137 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-dff177d0-cd19-4557-831f-504a5d6a695f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:16.258783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-dff177d0-cd19-4557-831f-504a5d6a695f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:16.259734 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-dff177d0-cd19-4557-831f-504a5d6a695f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:16.495545 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-dff177d0-cd19-4557-831f-504a5d6a695f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:16.509620 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-dff177d0-cd19-4557-831f-504a5d6a695f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.274446 Jul 31 18:38:16.509620 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 87/186] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:16 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:16.957254 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-c18b18c0-d44d-4014-9213-ea9b7e30bedd tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:16.958123 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-c18b18c0-d44d-4014-9213-ea9b7e30bedd tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:16.967436 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c18b18c0-d44d-4014-9213-ea9b7e30bedd tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:16.969356 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c18b18c0-d44d-4014-9213-ea9b7e30bedd tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:16.970818 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c18b18c0-d44d-4014-9213-ea9b7e30bedd tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:16.971852 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c18b18c0-d44d-4014-9213-ea9b7e30bedd tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:17.150215 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-c18b18c0-d44d-4014-9213-ea9b7e30bedd tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e518e5691a7247de9d04ae9828809498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eb8b8a120e4e87b4407d0abb3b3f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:17.160170 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-c18b18c0-d44d-4014-9213-ea9b7e30bedd tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 200 len: 1554 microversion: 2.1 time: 0.208619 Jul 31 18:38:17.161274 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 100/187] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:16 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 1554 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:17.530562 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-cca0ce8a-0fa4-49fa-bec7-4a82fb57445b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:17.531473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-cca0ce8a-0fa4-49fa-bec7-4a82fb57445b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:17.537735 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cca0ce8a-0fa4-49fa-bec7-4a82fb57445b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:17.538181 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cca0ce8a-0fa4-49fa-bec7-4a82fb57445b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:17.538971 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cca0ce8a-0fa4-49fa-bec7-4a82fb57445b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:17.539417 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cca0ce8a-0fa4-49fa-bec7-4a82fb57445b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:17.851848 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-cca0ce8a-0fa4-49fa-bec7-4a82fb57445b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:17.867700 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-cca0ce8a-0fa4-49fa-bec7-4a82fb57445b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.339423 Jul 31 18:38:17.869027 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 88/188] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:17 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:17.998703 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-f162ffef-f38e-4a40-854b-3b86ca24bc69 req-20b436a5-58b2-4db4-8742-5be725997693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3c5c619-b8b1-4c29-b8a1-e7427f571386", "name": "network-vif-deleted", "tag": "c9421a90-d6c6-4c5a-8004-5b32536878d2"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:38:18.042314 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-f162ffef-f38e-4a40-854b-3b86ca24bc69 req-20b436a5-58b2-4db4-8742-5be725997693 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:18.043448 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-f162ffef-f38e-4a40-854b-3b86ca24bc69 req-20b436a5-58b2-4db4-8742-5be725997693 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:18.062837 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-f162ffef-f38e-4a40-854b-3b86ca24bc69 req-20b436a5-58b2-4db4-8742-5be725997693 service nova] Creating event network-vif-deleted:c9421a90-d6c6-4c5a-8004-5b32536878d2 for instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 on hv-cinder-84984 Jul 31 18:38:18.100170 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-f162ffef-f38e-4a40-854b-3b86ca24bc69 req-20b436a5-58b2-4db4-8742-5be725997693 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111985 Jul 31 18:38:18.102553 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 101/189] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:38:18.185325 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-df5ac822-8833-4d94-a7ab-b6149438d208 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:18.186537 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-df5ac822-8833-4d94-a7ab-b6149438d208 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:18.192998 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-df5ac822-8833-4d94-a7ab-b6149438d208 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:18.193621 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-df5ac822-8833-4d94-a7ab-b6149438d208 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:18.194400 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-df5ac822-8833-4d94-a7ab-b6149438d208 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:18.194830 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-df5ac822-8833-4d94-a7ab-b6149438d208 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:18.272298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-df5ac822-8833-4d94-a7ab-b6149438d208 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e518e5691a7247de9d04ae9828809498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eb8b8a120e4e87b4407d0abb3b3f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:18.282161 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-df5ac822-8833-4d94-a7ab-b6149438d208 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 200 len: 1345 microversion: 2.1 time: 0.101568 Jul 31 18:38:18.285165 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 89/190] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:18 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 1345 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:18.890735 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-fedf66cf-ac94-445c-8360-15b110b517aa tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:18.891455 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-fedf66cf-ac94-445c-8360-15b110b517aa tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:18.901819 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fedf66cf-ac94-445c-8360-15b110b517aa tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:18.902495 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fedf66cf-ac94-445c-8360-15b110b517aa tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:18.903660 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fedf66cf-ac94-445c-8360-15b110b517aa tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:18.904251 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fedf66cf-ac94-445c-8360-15b110b517aa tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:19.053455 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-fedf66cf-ac94-445c-8360-15b110b517aa tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:19.060981 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-fedf66cf-ac94-445c-8360-15b110b517aa tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.174472 Jul 31 18:38:19.061565 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 102/191] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:18 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:19.303259 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-b5b28e88-416b-46dc-b42c-4a2a8cfd760d tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:19.303913 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-b5b28e88-416b-46dc-b42c-4a2a8cfd760d tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:19.310581 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b5b28e88-416b-46dc-b42c-4a2a8cfd760d tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:19.311023 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b5b28e88-416b-46dc-b42c-4a2a8cfd760d tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:19.311770 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b5b28e88-416b-46dc-b42c-4a2a8cfd760d tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:19.312367 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b5b28e88-416b-46dc-b42c-4a2a8cfd760d tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:19.344410 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b5b28e88-416b-46dc-b42c-4a2a8cfd760d tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:19.344880 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b5b28e88-416b-46dc-b42c-4a2a8cfd760d tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:19.345466 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.objects.instance [None req-b5b28e88-416b-46dc-b42c-4a2a8cfd760d tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lazy-loading 'fault' on Instance uuid d3c5c619-b8b1-4c29-b8a1-e7427f571386 {{(pid=124333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:38:19.399146 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-b5b28e88-416b-46dc-b42c-4a2a8cfd760d tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e518e5691a7247de9d04ae9828809498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eb8b8a120e4e87b4407d0abb3b3f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:19.407574 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-b5b28e88-416b-46dc-b42c-4a2a8cfd760d tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 200 len: 1350 microversion: 2.1 time: 0.108566 Jul 31 18:38:19.416801 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 90/192] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:19 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 1350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:20.081748 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-00bdd126-fb2e-4893-a614-10a5d8bbd1d8 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:20.082358 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-00bdd126-fb2e-4893-a614-10a5d8bbd1d8 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:20.100136 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-00bdd126-fb2e-4893-a614-10a5d8bbd1d8 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:20.101355 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-00bdd126-fb2e-4893-a614-10a5d8bbd1d8 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:20.102779 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-00bdd126-fb2e-4893-a614-10a5d8bbd1d8 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:20.103466 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-00bdd126-fb2e-4893-a614-10a5d8bbd1d8 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:20.270029 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-00bdd126-fb2e-4893-a614-10a5d8bbd1d8 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:20.278427 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-00bdd126-fb2e-4893-a614-10a5d8bbd1d8 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.200372 Jul 31 18:38:20.279816 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 103/193] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:20 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:20.429606 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-a6029e6f-e3be-4322-a66b-17407538f2e5 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:20.430214 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-a6029e6f-e3be-4322-a66b-17407538f2e5 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:20.437723 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a6029e6f-e3be-4322-a66b-17407538f2e5 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:20.438182 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a6029e6f-e3be-4322-a66b-17407538f2e5 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:20.439039 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a6029e6f-e3be-4322-a66b-17407538f2e5 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:20.439468 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a6029e6f-e3be-4322-a66b-17407538f2e5 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:20.454341 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-a6029e6f-e3be-4322-a66b-17407538f2e5 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] HTTP exception thrown: Instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 could not be found. Jul 31 18:38:20.459106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-a6029e6f-e3be-4322-a66b-17407538f2e5 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Request method failure captured: Jul 31 18:38:20.459106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 HTTP/1.1 Jul 31 18:38:20.459106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:38:20.459106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:38:20.459106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:38:20.459106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:38:20.459106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:38:20.459106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:38:20.459106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:38:20.459106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:38:20.459106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5svdlhp5i8lBtxWMRphH3iAWl8XtzjkZUpDlMrZPUUFNNLvjFbjH_Dcevl_burBkvmm5aN4LOjILhRSeDClG-KgfnXFUME-crqnQB1nj4W9c5-TPkdc1unRF4UX1lUNXnPoQw0jLJVRjSpnXoO5Gwo8I0Ih4kChkjbooApyg1ATY_p4 Jul 31 18:38:20.459106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:38:20.459106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:38:20.459106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:38:20.459106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:38:20.459106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:38:20.459106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:38:20.459106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: a2eb8b8a120e4e87b4407d0abb3b3f07 Jul 31 18:38:20.459106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-DeleteServersTestJSON-734375523 Jul 31 18:38:20.459106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:38:20.459106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:38:20.460398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2eb8b8a120e4e87b4407d0abb3b3f07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2eb8b8a120e4e87b4407d0abb3b3f07", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2eb8b8a120e4e87b4407d0abb3b3f07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2eb8b8a120e4e87b4407d0abb3b3f07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:38:20.460398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-DeleteServersTestJSON-734375523 Jul 31 18:38:20.460398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: a2eb8b8a120e4e87b4407d0abb3b3f07 Jul 31 18:38:20.460398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-DeleteServersTestJSON-734375523 Jul 31 18:38:20.460398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-DeleteServersTestJSON-734375523-project Jul 31 18:38:20.460398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:38:20.460398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:38:20.460398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: e518e5691a7247de9d04ae9828809498 Jul 31 18:38:20.460398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-DeleteServersTestJSON-734375523-project Jul 31 18:38:20.460398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: > Jul 31 18:38:20.460398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 could not be found. Jul 31 18:38:20.460398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': 'd3c5c619-b8b1-4c29-b8a1-e7427f571386'} Jul 31 18:38:20.461178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:38:20.461178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:38:20.461178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:38:20.461178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:38:20.461178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:38:20.461178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:38:20.461178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:38:20.461178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:38:20.461178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:38:20.461178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:38:20.461178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 could not be found. Jul 31 18:38:20.461178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:38:20.461178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:38:20.461178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:38:20.461178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:38:20.461178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:38:20.461178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:38:20.461178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:38:20.461178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:38:20.461178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:38:20.462710 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:38:20.462710 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:38:20.462710 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:38:20.462710 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:38:20.462710 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:38:20.462710 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:38:20.462710 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:38:20.462710 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 could not be found. Jul 31 18:38:20.462710 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:38:20.462710 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:38:20.462710 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:38:20.462710 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:38:20.462710 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:38:20.462710 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:38:20.462710 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:38:20.462710 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:38:20.462710 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 could not be found. Jul 31 18:38:20.462710 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:38:20.463899 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-a6029e6f-e3be-4322-a66b-17407538f2e5 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Returning 404 to user: Instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:38:20.463899 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-a6029e6f-e3be-4322-a66b-17407538f2e5 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 404 len: 111 microversion: 2.1 time: 0.034916 Jul 31 18:38:20.463899 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 91/194] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:20 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:38:20.575161 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4c3f9f5d-7d9d-4cb6-979e-d5c2484d03b6 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:20.577503 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-4c3f9f5d-7d9d-4cb6-979e-d5c2484d03b6 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:20.584037 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4c3f9f5d-7d9d-4cb6-979e-d5c2484d03b6 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:20.584514 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4c3f9f5d-7d9d-4cb6-979e-d5c2484d03b6 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:20.585314 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4c3f9f5d-7d9d-4cb6-979e-d5c2484d03b6 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:20.585776 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4c3f9f5d-7d9d-4cb6-979e-d5c2484d03b6 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:20.602472 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-4c3f9f5d-7d9d-4cb6-979e-d5c2484d03b6 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] HTTP exception thrown: Instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 could not be found. Jul 31 18:38:20.608308 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4c3f9f5d-7d9d-4cb6-979e-d5c2484d03b6 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Request method failure captured: Jul 31 18:38:20.608308 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386/os-volume_attachments HTTP/1.1 Jul 31 18:38:20.608308 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:38:20.608308 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:38:20.608308 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:38:20.608308 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 0 Jul 31 18:38:20.608308 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:38:20.608308 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:38:20.608308 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:38:20.608308 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:38:20.608308 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5svdlhp5i8lBtxWMRphH3iAWl8XtzjkZUpDlMrZPUUFNNLvjFbjH_Dcevl_burBkvmm5aN4LOjILhRSeDClG-KgfnXFUME-crqnQB1nj4W9c5-TPkdc1unRF4UX1lUNXnPoQw0jLJVRjSpnXoO5Gwo8I0Ih4kChkjbooApyg1ATY_p4 Jul 31 18:38:20.608308 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:38:20.608308 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:38:20.608308 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:38:20.608308 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:38:20.608308 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:38:20.608308 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:38:20.608308 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: a2eb8b8a120e4e87b4407d0abb3b3f07 Jul 31 18:38:20.608308 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-DeleteServersTestJSON-734375523 Jul 31 18:38:20.608308 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:38:20.608308 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:38:20.610333 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2eb8b8a120e4e87b4407d0abb3b3f07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2eb8b8a120e4e87b4407d0abb3b3f07", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2eb8b8a120e4e87b4407d0abb3b3f07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2eb8b8a120e4e87b4407d0abb3b3f07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:38:20.610333 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-DeleteServersTestJSON-734375523 Jul 31 18:38:20.610333 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: a2eb8b8a120e4e87b4407d0abb3b3f07 Jul 31 18:38:20.610333 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-DeleteServersTestJSON-734375523 Jul 31 18:38:20.610333 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-DeleteServersTestJSON-734375523-project Jul 31 18:38:20.610333 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:38:20.610333 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:38:20.610333 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: e518e5691a7247de9d04ae9828809498 Jul 31 18:38:20.610333 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-DeleteServersTestJSON-734375523-project Jul 31 18:38:20.610333 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: > Jul 31 18:38:20.610333 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 could not be found. Jul 31 18:38:20.610333 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'server_id': 'd3c5c619-b8b1-4c29-b8a1-e7427f571386'} Jul 31 18:38:20.611660 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:38:20.611660 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:38:20.611660 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:38:20.611660 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:38:20.611660 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:38:20.611660 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:38:20.611660 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:38:20.611660 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:38:20.611660 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:38:20.611660 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:38:20.611660 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 could not be found. Jul 31 18:38:20.611660 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:38:20.611660 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:38:20.611660 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:38:20.611660 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:38:20.611660 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:38:20.611660 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:38:20.611660 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:38:20.611660 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:38:20.611660 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:38:20.613218 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:38:20.613218 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 18:38:20.613218 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 18:38:20.613218 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 18:38:20.613218 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 18:38:20.613218 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 31 18:38:20.613218 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 31 18:38:20.613218 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:38:20.613218 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:38:20.613218 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 could not be found. Jul 31 18:38:20.613218 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:38:20.613218 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:38:20.613218 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:38:20.613218 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:38:20.613218 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:38:20.613218 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:38:20.613218 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:38:20.613218 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:38:20.613218 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 could not be found. Jul 31 18:38:20.613218 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:38:20.614558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4c3f9f5d-7d9d-4cb6-979e-d5c2484d03b6 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Returning 404 to user: Instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 could not be found. {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:38:20.614558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-4c3f9f5d-7d9d-4cb6-979e-d5c2484d03b6 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039460 Jul 31 18:38:20.614558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 104/195] 10.222.0.49 () {58 vars in 1302 bytes} [Sun Jul 31 18:38:20 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 18:38:21.301545 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-bfff8c8b-6025-4554-b328-5f009181ba2b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:21.302235 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-bfff8c8b-6025-4554-b328-5f009181ba2b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:21.308971 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bfff8c8b-6025-4554-b328-5f009181ba2b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:21.312879 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bfff8c8b-6025-4554-b328-5f009181ba2b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:21.313687 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bfff8c8b-6025-4554-b328-5f009181ba2b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:21.314124 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bfff8c8b-6025-4554-b328-5f009181ba2b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:21.446698 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-bfff8c8b-6025-4554-b328-5f009181ba2b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:21.454552 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-bfff8c8b-6025-4554-b328-5f009181ba2b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.157243 Jul 31 18:38:21.455115 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 92/196] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:21 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:21.824397 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-6420c87d-e52e-46e6-aecc-ebb8557fadc1 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:21.825018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-6420c87d-e52e-46e6-aecc-ebb8557fadc1 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:21.832616 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6420c87d-e52e-46e6-aecc-ebb8557fadc1 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:21.833119 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6420c87d-e52e-46e6-aecc-ebb8557fadc1 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:21.833880 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6420c87d-e52e-46e6-aecc-ebb8557fadc1 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:21.834310 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6420c87d-e52e-46e6-aecc-ebb8557fadc1 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:21.848328 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-6420c87d-e52e-46e6-aecc-ebb8557fadc1 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] HTTP exception thrown: Instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 could not be found. Jul 31 18:38:21.850617 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-6420c87d-e52e-46e6-aecc-ebb8557fadc1 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Request method failure captured: Jul 31 18:38:21.850617 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: DELETE /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 HTTP/1.1 Jul 31 18:38:21.850617 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:38:21.850617 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:38:21.850617 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:38:21.850617 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 0 Jul 31 18:38:21.850617 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:38:21.850617 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:38:21.850617 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:38:21.850617 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:38:21.850617 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5svdlhp5i8lBtxWMRphH3iAWl8XtzjkZUpDlMrZPUUFNNLvjFbjH_Dcevl_burBkvmm5aN4LOjILhRSeDClG-KgfnXFUME-crqnQB1nj4W9c5-TPkdc1unRF4UX1lUNXnPoQw0jLJVRjSpnXoO5Gwo8I0Ih4kChkjbooApyg1ATY_p4 Jul 31 18:38:21.850617 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:38:21.850617 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:38:21.850617 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:38:21.850617 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:38:21.850617 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:38:21.850617 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:38:21.850617 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: a2eb8b8a120e4e87b4407d0abb3b3f07 Jul 31 18:38:21.850617 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-DeleteServersTestJSON-734375523 Jul 31 18:38:21.850617 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:38:21.850617 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:38:21.851921 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2eb8b8a120e4e87b4407d0abb3b3f07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2eb8b8a120e4e87b4407d0abb3b3f07", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2eb8b8a120e4e87b4407d0abb3b3f07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2eb8b8a120e4e87b4407d0abb3b3f07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:38:21.851921 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-DeleteServersTestJSON-734375523 Jul 31 18:38:21.851921 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: a2eb8b8a120e4e87b4407d0abb3b3f07 Jul 31 18:38:21.851921 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-DeleteServersTestJSON-734375523 Jul 31 18:38:21.851921 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-DeleteServersTestJSON-734375523-project Jul 31 18:38:21.851921 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:38:21.851921 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:38:21.851921 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: e518e5691a7247de9d04ae9828809498 Jul 31 18:38:21.851921 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-DeleteServersTestJSON-734375523-project Jul 31 18:38:21.851921 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: > Jul 31 18:38:21.851921 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 could not be found. Jul 31 18:38:21.851921 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'id': 'd3c5c619-b8b1-4c29-b8a1-e7427f571386'} Jul 31 18:38:21.852558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:38:21.852558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:38:21.852558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:38:21.852558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:38:21.852558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:38:21.852558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:38:21.852558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:38:21.852558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:38:21.852558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:38:21.852558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:38:21.852558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 could not be found. Jul 31 18:38:21.852558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:38:21.852558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:38:21.852558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:38:21.852558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:38:21.852558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:38:21.852558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:38:21.852558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:38:21.852558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:38:21.852558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:38:21.854498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:38:21.854498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 18:38:21.854498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 18:38:21.854498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 18:38:21.854498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 18:38:21.854498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:38:21.854498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:38:21.854498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:38:21.854498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:38:21.854498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 could not be found. Jul 31 18:38:21.854498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:38:21.854498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:38:21.854498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:38:21.854498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:38:21.854498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:38:21.854498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:38:21.854498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:38:21.854498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:38:21.854498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 could not be found. Jul 31 18:38:21.854498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:38:21.856429 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-6420c87d-e52e-46e6-aecc-ebb8557fadc1 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Returning 404 to user: Instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 could not be found. {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:38:21.856429 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-6420c87d-e52e-46e6-aecc-ebb8557fadc1 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 404 len: 111 microversion: 2.1 time: 0.032167 Jul 31 18:38:21.856429 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 105/197] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:38:21 2022] DELETE /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:38:21.862374 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-ada33998-c31a-4114-86c3-da98a099d8e9 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:21.862978 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-ada33998-c31a-4114-86c3-da98a099d8e9 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] [instance: d3c5c619-b8b1-4c29-b8a1-e7427f571386] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:21.869549 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ada33998-c31a-4114-86c3-da98a099d8e9 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:21.870002 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ada33998-c31a-4114-86c3-da98a099d8e9 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:21.870748 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ada33998-c31a-4114-86c3-da98a099d8e9 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:21.871175 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ada33998-c31a-4114-86c3-da98a099d8e9 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:21.885796 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-ada33998-c31a-4114-86c3-da98a099d8e9 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] HTTP exception thrown: Instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 could not be found. Jul 31 18:38:21.887298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-ada33998-c31a-4114-86c3-da98a099d8e9 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Request method failure captured: Jul 31 18:38:21.887298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 HTTP/1.1 Jul 31 18:38:21.887298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:38:21.887298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:38:21.887298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:38:21.887298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:38:21.887298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:38:21.887298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:38:21.887298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:38:21.887298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:38:21.887298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5svdlhp5i8lBtxWMRphH3iAWl8XtzjkZUpDlMrZPUUFNNLvjFbjH_Dcevl_burBkvmm5aN4LOjILhRSeDClG-KgfnXFUME-crqnQB1nj4W9c5-TPkdc1unRF4UX1lUNXnPoQw0jLJVRjSpnXoO5Gwo8I0Ih4kChkjbooApyg1ATY_p4 Jul 31 18:38:21.887298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:38:21.887298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:38:21.887298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:38:21.887298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:38:21.887298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:38:21.887298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:38:21.887298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: a2eb8b8a120e4e87b4407d0abb3b3f07 Jul 31 18:38:21.887298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-DeleteServersTestJSON-734375523 Jul 31 18:38:21.887298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:38:21.887298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:38:21.888702 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2eb8b8a120e4e87b4407d0abb3b3f07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2eb8b8a120e4e87b4407d0abb3b3f07", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2eb8b8a120e4e87b4407d0abb3b3f07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2eb8b8a120e4e87b4407d0abb3b3f07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:38:21.888702 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-DeleteServersTestJSON-734375523 Jul 31 18:38:21.888702 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: a2eb8b8a120e4e87b4407d0abb3b3f07 Jul 31 18:38:21.888702 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-DeleteServersTestJSON-734375523 Jul 31 18:38:21.888702 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-DeleteServersTestJSON-734375523-project Jul 31 18:38:21.888702 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:38:21.888702 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:38:21.888702 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: e518e5691a7247de9d04ae9828809498 Jul 31 18:38:21.888702 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-DeleteServersTestJSON-734375523-project Jul 31 18:38:21.888702 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: > Jul 31 18:38:21.888702 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 could not be found. Jul 31 18:38:21.888702 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': 'd3c5c619-b8b1-4c29-b8a1-e7427f571386'} Jul 31 18:38:21.889390 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:38:21.889390 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:38:21.889390 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:38:21.889390 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:38:21.889390 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:38:21.889390 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:38:21.889390 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:38:21.889390 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:38:21.889390 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:38:21.889390 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:38:21.889390 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 could not be found. Jul 31 18:38:21.889390 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:38:21.889390 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:38:21.889390 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:38:21.889390 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:38:21.889390 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:38:21.889390 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:38:21.889390 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:38:21.889390 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:38:21.889390 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:38:21.890502 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:38:21.890502 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:38:21.890502 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:38:21.890502 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:38:21.890502 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:38:21.890502 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:38:21.890502 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:38:21.890502 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 could not be found. Jul 31 18:38:21.890502 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:38:21.890502 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:38:21.890502 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:38:21.890502 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:38:21.890502 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:38:21.890502 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:38:21.890502 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:38:21.890502 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:38:21.890502 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 could not be found. Jul 31 18:38:21.890502 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:38:21.891632 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-ada33998-c31a-4114-86c3-da98a099d8e9 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] Returning 404 to user: Instance d3c5c619-b8b1-4c29-b8a1-e7427f571386 could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:38:21.891632 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-ada33998-c31a-4114-86c3-da98a099d8e9 tempest-DeleteServersTestJSON-734375523 tempest-DeleteServersTestJSON-734375523-project] 10.222.0.49 "GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386" status: 404 len: 111 microversion: 2.1 time: 0.030592 Jul 31 18:38:21.891632 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 93/198] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:21 2022] GET /compute/v2.1/servers/d3c5c619-b8b1-4c29-b8a1-e7427f571386 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:38:22.475793 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-80a35bb4-61d1-439b-83fd-c9ca58542002 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:22.476320 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-80a35bb4-61d1-439b-83fd-c9ca58542002 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:22.482971 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-80a35bb4-61d1-439b-83fd-c9ca58542002 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:22.483503 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-80a35bb4-61d1-439b-83fd-c9ca58542002 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:22.484295 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-80a35bb4-61d1-439b-83fd-c9ca58542002 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:22.484703 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-80a35bb4-61d1-439b-83fd-c9ca58542002 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:22.618236 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-80a35bb4-61d1-439b-83fd-c9ca58542002 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:22.626192 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-80a35bb4-61d1-439b-83fd-c9ca58542002 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.154475 Jul 31 18:38:22.627220 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 106/199] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:22 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:23.647467 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-ad010958-1abe-44e8-8e4e-1cc1e7b075d1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:23.648179 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-ad010958-1abe-44e8-8e4e-1cc1e7b075d1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:23.665020 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ad010958-1abe-44e8-8e4e-1cc1e7b075d1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:23.665884 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ad010958-1abe-44e8-8e4e-1cc1e7b075d1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:23.667255 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ad010958-1abe-44e8-8e4e-1cc1e7b075d1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:23.667922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ad010958-1abe-44e8-8e4e-1cc1e7b075d1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:23.957840 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-ad010958-1abe-44e8-8e4e-1cc1e7b075d1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:23.966962 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-ad010958-1abe-44e8-8e4e-1cc1e7b075d1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.323197 Jul 31 18:38:23.968818 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 94/200] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:23 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:24.988622 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f780d386-2f49-4a7b-9245-8f0c9fad1fbb tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:24.989458 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-f780d386-2f49-4a7b-9245-8f0c9fad1fbb tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:24.999318 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f780d386-2f49-4a7b-9245-8f0c9fad1fbb tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:24.999771 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f780d386-2f49-4a7b-9245-8f0c9fad1fbb tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:25.000601 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f780d386-2f49-4a7b-9245-8f0c9fad1fbb tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:25.001070 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f780d386-2f49-4a7b-9245-8f0c9fad1fbb tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:25.247430 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-f780d386-2f49-4a7b-9245-8f0c9fad1fbb tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:25.265505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-f780d386-2f49-4a7b-9245-8f0c9fad1fbb tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.273323 Jul 31 18:38:25.284176 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 107/201] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:24 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:26.291645 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-1a10f346-89f0-42b3-80eb-051fede521ce tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:26.292930 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-1a10f346-89f0-42b3-80eb-051fede521ce tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:26.299740 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1a10f346-89f0-42b3-80eb-051fede521ce tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:26.300185 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1a10f346-89f0-42b3-80eb-051fede521ce tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:26.301006 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1a10f346-89f0-42b3-80eb-051fede521ce tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:26.301438 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1a10f346-89f0-42b3-80eb-051fede521ce tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:26.461615 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-1a10f346-89f0-42b3-80eb-051fede521ce tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:26.480879 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-1a10f346-89f0-42b3-80eb-051fede521ce tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.191608 Jul 31 18:38:26.481775 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 95/202] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:26 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:27.502029 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-16901a33-db28-499e-b59a-4631139e4102 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:27.502627 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-16901a33-db28-499e-b59a-4631139e4102 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:27.510682 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-16901a33-db28-499e-b59a-4631139e4102 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:27.511133 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-16901a33-db28-499e-b59a-4631139e4102 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:27.511890 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-16901a33-db28-499e-b59a-4631139e4102 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:27.512316 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-16901a33-db28-499e-b59a-4631139e4102 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:27.672821 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-16901a33-db28-499e-b59a-4631139e4102 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:27.683635 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-16901a33-db28-499e-b59a-4631139e4102 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.185418 Jul 31 18:38:27.684450 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 108/203] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:27 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:28.706423 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-ae501044-d949-483a-b663-6151fd163841 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:28.707131 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-ae501044-d949-483a-b663-6151fd163841 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:28.714127 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ae501044-d949-483a-b663-6151fd163841 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:28.714613 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ae501044-d949-483a-b663-6151fd163841 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:28.715450 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ae501044-d949-483a-b663-6151fd163841 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:28.715910 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ae501044-d949-483a-b663-6151fd163841 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:28.864049 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-ae501044-d949-483a-b663-6151fd163841 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:28.871783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-ae501044-d949-483a-b663-6151fd163841 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.169703 Jul 31 18:38:28.872349 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 96/204] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:28 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:29.894454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-85be64b2-3be6-4f82-b6ce-b7740b512aa5 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:29.894909 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-85be64b2-3be6-4f82-b6ce-b7740b512aa5 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:29.901743 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-85be64b2-3be6-4f82-b6ce-b7740b512aa5 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:29.902189 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-85be64b2-3be6-4f82-b6ce-b7740b512aa5 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:29.902965 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-85be64b2-3be6-4f82-b6ce-b7740b512aa5 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:29.903380 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-85be64b2-3be6-4f82-b6ce-b7740b512aa5 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:30.037352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-85be64b2-3be6-4f82-b6ce-b7740b512aa5 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:30.044994 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-85be64b2-3be6-4f82-b6ce-b7740b512aa5 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.154721 Jul 31 18:38:30.045560 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 109/205] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:29 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:31.066355 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-c4b45842-33f9-4624-b74c-3533e3dc5c3a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:31.066928 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-c4b45842-33f9-4624-b74c-3533e3dc5c3a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:31.073567 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c4b45842-33f9-4624-b74c-3533e3dc5c3a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:31.074016 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c4b45842-33f9-4624-b74c-3533e3dc5c3a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:31.074778 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c4b45842-33f9-4624-b74c-3533e3dc5c3a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:31.075210 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c4b45842-33f9-4624-b74c-3533e3dc5c3a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:31.207187 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-c4b45842-33f9-4624-b74c-3533e3dc5c3a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:31.214970 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-c4b45842-33f9-4624-b74c-3533e3dc5c3a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.152489 Jul 31 18:38:31.215536 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 97/206] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:31 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:32.235876 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-cead19f4-0781-45ea-86b2-9735f7e9907c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:32.236482 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-cead19f4-0781-45ea-86b2-9735f7e9907c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:32.243128 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cead19f4-0781-45ea-86b2-9735f7e9907c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:32.243586 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cead19f4-0781-45ea-86b2-9735f7e9907c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:32.244325 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cead19f4-0781-45ea-86b2-9735f7e9907c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:32.244745 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cead19f4-0781-45ea-86b2-9735f7e9907c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:32.378364 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-cead19f4-0781-45ea-86b2-9735f7e9907c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:32.386729 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-cead19f4-0781-45ea-86b2-9735f7e9907c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.154821 Jul 31 18:38:32.387294 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 110/207] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:32 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:33.407651 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-b059108b-af71-40f2-95a8-0f331b47d036 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:33.408255 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-b059108b-af71-40f2-95a8-0f331b47d036 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:33.414429 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b059108b-af71-40f2-95a8-0f331b47d036 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:33.415425 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b059108b-af71-40f2-95a8-0f331b47d036 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:33.416180 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b059108b-af71-40f2-95a8-0f331b47d036 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:33.416707 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b059108b-af71-40f2-95a8-0f331b47d036 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:33.434909 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:33.553615 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-b059108b-af71-40f2-95a8-0f331b47d036 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:33.561580 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-b059108b-af71-40f2-95a8-0f331b47d036 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.157739 Jul 31 18:38:33.562242 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 98/208] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:33 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:34.587587 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-bcac5bd8-94e7-479a-9a63-cc1d5881c501 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:34.588736 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-bcac5bd8-94e7-479a-9a63-cc1d5881c501 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:34.597288 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-bcac5bd8-94e7-479a-9a63-cc1d5881c501 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:34.597736 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-bcac5bd8-94e7-479a-9a63-cc1d5881c501 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:34.598499 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-bcac5bd8-94e7-479a-9a63-cc1d5881c501 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:34.598959 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-bcac5bd8-94e7-479a-9a63-cc1d5881c501 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:34.742261 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-bcac5bd8-94e7-479a-9a63-cc1d5881c501 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:34.750494 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-bcac5bd8-94e7-479a-9a63-cc1d5881c501 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.169504 Jul 31 18:38:34.751089 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 111/209] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:34 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:35.773919 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-aea4816b-3d60-4d55-a595-fe240c6371b4 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:35.774677 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-aea4816b-3d60-4d55-a595-fe240c6371b4 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:35.782952 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-aea4816b-3d60-4d55-a595-fe240c6371b4 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:35.783544 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-aea4816b-3d60-4d55-a595-fe240c6371b4 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:35.784549 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-aea4816b-3d60-4d55-a595-fe240c6371b4 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:35.785169 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-aea4816b-3d60-4d55-a595-fe240c6371b4 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:35.922884 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-aea4816b-3d60-4d55-a595-fe240c6371b4 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:35.930712 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-aea4816b-3d60-4d55-a595-fe240c6371b4 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.162112 Jul 31 18:38:35.931262 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 99/210] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:35 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:36.955864 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-96f1468e-9b19-4032-ae6b-6e4a8466d7bc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:36.956531 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-96f1468e-9b19-4032-ae6b-6e4a8466d7bc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:36.965164 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-96f1468e-9b19-4032-ae6b-6e4a8466d7bc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:36.965778 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-96f1468e-9b19-4032-ae6b-6e4a8466d7bc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:36.966809 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-96f1468e-9b19-4032-ae6b-6e4a8466d7bc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:36.967242 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-96f1468e-9b19-4032-ae6b-6e4a8466d7bc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:37.105632 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-96f1468e-9b19-4032-ae6b-6e4a8466d7bc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:37.113328 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-96f1468e-9b19-4032-ae6b-6e4a8466d7bc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.163661 Jul 31 18:38:37.113917 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 112/211] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:36 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:38.134936 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-be29ae09-bcbb-4ec6-bd92-72049f6e70ac tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:38.135540 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-be29ae09-bcbb-4ec6-bd92-72049f6e70ac tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:38.142018 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-be29ae09-bcbb-4ec6-bd92-72049f6e70ac tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:38.142461 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-be29ae09-bcbb-4ec6-bd92-72049f6e70ac tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:38.143214 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-be29ae09-bcbb-4ec6-bd92-72049f6e70ac tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:38.143662 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-be29ae09-bcbb-4ec6-bd92-72049f6e70ac tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:38.275348 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-be29ae09-bcbb-4ec6-bd92-72049f6e70ac tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:38.282913 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-be29ae09-bcbb-4ec6-bd92-72049f6e70ac tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.151866 Jul 31 18:38:38.283471 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 100/212] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:38 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:39.303969 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-422a380c-a08c-4802-98d7-8fedcc03d3ae tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:39.304685 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-422a380c-a08c-4802-98d7-8fedcc03d3ae tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:39.312006 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-422a380c-a08c-4802-98d7-8fedcc03d3ae tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:39.312445 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-422a380c-a08c-4802-98d7-8fedcc03d3ae tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:39.313235 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-422a380c-a08c-4802-98d7-8fedcc03d3ae tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:39.313663 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-422a380c-a08c-4802-98d7-8fedcc03d3ae tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:39.454515 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-422a380c-a08c-4802-98d7-8fedcc03d3ae tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:39.462186 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-422a380c-a08c-4802-98d7-8fedcc03d3ae tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.162130 Jul 31 18:38:39.462757 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 113/213] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:39 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:40.483194 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-12440f6f-4849-428e-b0ee-a061417597fd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:40.483821 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-12440f6f-4849-428e-b0ee-a061417597fd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:40.485732 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:40.492110 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-12440f6f-4849-428e-b0ee-a061417597fd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:40.492565 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-12440f6f-4849-428e-b0ee-a061417597fd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:40.493411 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-12440f6f-4849-428e-b0ee-a061417597fd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:40.493836 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-12440f6f-4849-428e-b0ee-a061417597fd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:40.628283 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-12440f6f-4849-428e-b0ee-a061417597fd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:40.636336 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-12440f6f-4849-428e-b0ee-a061417597fd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.157357 Jul 31 18:38:40.636917 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 101/214] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:40 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:41.657686 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-26fa68e6-54a2-436e-a41e-0cc9d41729ca tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:41.658356 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-26fa68e6-54a2-436e-a41e-0cc9d41729ca tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:41.665757 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-26fa68e6-54a2-436e-a41e-0cc9d41729ca tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:41.666210 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-26fa68e6-54a2-436e-a41e-0cc9d41729ca tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:41.666985 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-26fa68e6-54a2-436e-a41e-0cc9d41729ca tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:41.667453 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-26fa68e6-54a2-436e-a41e-0cc9d41729ca tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:41.803506 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-26fa68e6-54a2-436e-a41e-0cc9d41729ca tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:41.811326 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-26fa68e6-54a2-436e-a41e-0cc9d41729ca tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.157622 Jul 31 18:38:41.811897 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 114/215] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:41 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:42.839737 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-01ff97a8-d668-44e2-b3c6-b5efc6e64e5d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:42.840340 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-01ff97a8-d668-44e2-b3c6-b5efc6e64e5d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:42.846685 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-01ff97a8-d668-44e2-b3c6-b5efc6e64e5d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:42.847133 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-01ff97a8-d668-44e2-b3c6-b5efc6e64e5d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:42.847887 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-01ff97a8-d668-44e2-b3c6-b5efc6e64e5d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:42.848311 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-01ff97a8-d668-44e2-b3c6-b5efc6e64e5d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:42.982393 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-01ff97a8-d668-44e2-b3c6-b5efc6e64e5d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:42.990730 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-01ff97a8-d668-44e2-b3c6-b5efc6e64e5d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.154803 Jul 31 18:38:42.991282 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 102/216] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:42 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:44.013572 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-93f0bd98-0e06-4bfc-9c8c-8f858d0f9c4b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:44.014238 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-93f0bd98-0e06-4bfc-9c8c-8f858d0f9c4b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:44.021949 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-93f0bd98-0e06-4bfc-9c8c-8f858d0f9c4b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:44.022440 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-93f0bd98-0e06-4bfc-9c8c-8f858d0f9c4b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:44.023284 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-93f0bd98-0e06-4bfc-9c8c-8f858d0f9c4b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:44.023760 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-93f0bd98-0e06-4bfc-9c8c-8f858d0f9c4b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:44.168742 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-93f0bd98-0e06-4bfc-9c8c-8f858d0f9c4b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:44.176555 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-93f0bd98-0e06-4bfc-9c8c-8f858d0f9c4b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.167962 Jul 31 18:38:44.177160 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 115/217] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:44 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:45.197813 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-a5bcdf64-39ec-4011-9f16-7bef2c3725da tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:45.198418 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-a5bcdf64-39ec-4011-9f16-7bef2c3725da tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:45.205225 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a5bcdf64-39ec-4011-9f16-7bef2c3725da tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:45.205700 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a5bcdf64-39ec-4011-9f16-7bef2c3725da tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:45.206657 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a5bcdf64-39ec-4011-9f16-7bef2c3725da tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:45.206986 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a5bcdf64-39ec-4011-9f16-7bef2c3725da tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:45.339770 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-a5bcdf64-39ec-4011-9f16-7bef2c3725da tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:45.347682 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-a5bcdf64-39ec-4011-9f16-7bef2c3725da tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.153485 Jul 31 18:38:45.348612 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 103/218] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:45 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:46.371249 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-fc56a7d9-a8e4-462e-ab75-76f6da094e37 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:46.371836 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-fc56a7d9-a8e4-462e-ab75-76f6da094e37 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:46.374455 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=33 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:46.380241 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fc56a7d9-a8e4-462e-ab75-76f6da094e37 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:46.380688 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fc56a7d9-a8e4-462e-ab75-76f6da094e37 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:46.381472 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fc56a7d9-a8e4-462e-ab75-76f6da094e37 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:46.381897 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fc56a7d9-a8e4-462e-ab75-76f6da094e37 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:46.384630 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=89 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:38:46.520005 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-fc56a7d9-a8e4-462e-ab75-76f6da094e37 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:46.528113 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-fc56a7d9-a8e4-462e-ab75-76f6da094e37 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.160694 Jul 31 18:38:46.528718 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 116/219] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:46 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:47.553007 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-f758e429-eb36-4d8c-bb1a-0c0ea4beb408 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:47.553550 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-f758e429-eb36-4d8c-bb1a-0c0ea4beb408 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:47.560031 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f758e429-eb36-4d8c-bb1a-0c0ea4beb408 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:47.560498 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f758e429-eb36-4d8c-bb1a-0c0ea4beb408 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:47.561268 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f758e429-eb36-4d8c-bb1a-0c0ea4beb408 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:47.561695 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f758e429-eb36-4d8c-bb1a-0c0ea4beb408 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:47.693561 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-f758e429-eb36-4d8c-bb1a-0c0ea4beb408 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:47.701139 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-f758e429-eb36-4d8c-bb1a-0c0ea4beb408 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.153015 Jul 31 18:38:47.701699 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 104/220] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:47 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:48.721928 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-c14f6681-31c5-4ad9-924b-9b77259bb227 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:48.722560 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-c14f6681-31c5-4ad9-924b-9b77259bb227 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:48.729273 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c14f6681-31c5-4ad9-924b-9b77259bb227 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:48.729721 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c14f6681-31c5-4ad9-924b-9b77259bb227 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:48.730486 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c14f6681-31c5-4ad9-924b-9b77259bb227 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:48.730921 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c14f6681-31c5-4ad9-924b-9b77259bb227 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:48.875305 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-c14f6681-31c5-4ad9-924b-9b77259bb227 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:48.884280 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-c14f6681-31c5-4ad9-924b-9b77259bb227 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.166387 Jul 31 18:38:48.884874 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 117/221] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:48 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:49.904567 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-d9fed190-9269-49ab-ab71-498db960ff0c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:49.905186 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-d9fed190-9269-49ab-ab71-498db960ff0c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:49.911315 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d9fed190-9269-49ab-ab71-498db960ff0c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:49.911785 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d9fed190-9269-49ab-ab71-498db960ff0c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:49.912570 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d9fed190-9269-49ab-ab71-498db960ff0c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:49.913048 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d9fed190-9269-49ab-ab71-498db960ff0c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:50.049543 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-d9fed190-9269-49ab-ab71-498db960ff0c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:50.058188 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-d9fed190-9269-49ab-ab71-498db960ff0c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.157432 Jul 31 18:38:50.058804 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 105/222] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:49 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:51.079805 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-cb062943-0733-41ae-b9f0-cd0784d634ac tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:51.080409 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-cb062943-0733-41ae-b9f0-cd0784d634ac tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:51.087661 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cb062943-0733-41ae-b9f0-cd0784d634ac tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:51.088115 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cb062943-0733-41ae-b9f0-cd0784d634ac tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:51.089150 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cb062943-0733-41ae-b9f0-cd0784d634ac tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:51.089737 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cb062943-0733-41ae-b9f0-cd0784d634ac tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:51.241505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-cb062943-0733-41ae-b9f0-cd0784d634ac tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:51.251239 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-cb062943-0733-41ae-b9f0-cd0784d634ac tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1522 microversion: 2.1 time: 0.175261 Jul 31 18:38:51.252364 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 118/223] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:51 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:52.274059 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-a0d56ec8-da3e-486c-912b-24680a443243 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:52.274718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-a0d56ec8-da3e-486c-912b-24680a443243 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:52.291163 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a0d56ec8-da3e-486c-912b-24680a443243 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:52.291615 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a0d56ec8-da3e-486c-912b-24680a443243 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:52.292395 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a0d56ec8-da3e-486c-912b-24680a443243 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:52.292849 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a0d56ec8-da3e-486c-912b-24680a443243 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:52.440126 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-a0d56ec8-da3e-486c-912b-24680a443243 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:52.448075 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-a0d56ec8-da3e-486c-912b-24680a443243 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1502 microversion: 2.1 time: 0.178115 Jul 31 18:38:52.448647 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 106/224] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:52 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1502 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:52.471223 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-802229a8-2008-4a44-8439-c6af564a7fe0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:52.471839 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-802229a8-2008-4a44-8439-c6af564a7fe0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:52.488250 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-802229a8-2008-4a44-8439-c6af564a7fe0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:52.488696 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-802229a8-2008-4a44-8439-c6af564a7fe0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:52.489496 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-802229a8-2008-4a44-8439-c6af564a7fe0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:52.489928 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-802229a8-2008-4a44-8439-c6af564a7fe0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:52.648801 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-802229a8-2008-4a44-8439-c6af564a7fe0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:52.656414 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-802229a8-2008-4a44-8439-c6af564a7fe0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1515 microversion: 2.1 time: 0.191658 Jul 31 18:38:52.656955 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 119/225] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:52 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1515 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:54.075053 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-07e45854-54d2-4123-995d-fb0ee6a27483 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:38:54.077319 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-07e45854-54d2-4123-995d-fb0ee6a27483 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:54.083628 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-07e45854-54d2-4123-995d-fb0ee6a27483 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:54.084079 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-07e45854-54d2-4123-995d-fb0ee6a27483 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:54.084868 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-07e45854-54d2-4123-995d-fb0ee6a27483 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:54.085306 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-07e45854-54d2-4123-995d-fb0ee6a27483 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:54.109314 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.objects.instance [None req-07e45854-54d2-4123-995d-fb0ee6a27483 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lazy-loading 'flavor' on Instance uuid 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c {{(pid=124333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:38:54.187822 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-07e45854-54d2-4123-995d-fb0ee6a27483 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "POST /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c/action" status: 200 len: 32 microversion: 2.1 time: 0.116698 Jul 31 18:38:54.188511 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 107/226] 10.222.0.49 () {60 vars in 1278 bytes} [Sun Jul 31 18:38:54 2022] POST /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c/action => generated 32 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 18:38:54.197978 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-a09546c2-adc5-4da2-a4a3-231d7f8187e7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:54.198590 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-a09546c2-adc5-4da2-a4a3-231d7f8187e7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:54.205281 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a09546c2-adc5-4da2-a4a3-231d7f8187e7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:54.205898 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a09546c2-adc5-4da2-a4a3-231d7f8187e7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:54.206673 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a09546c2-adc5-4da2-a4a3-231d7f8187e7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:54.207154 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a09546c2-adc5-4da2-a4a3-231d7f8187e7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:54.343767 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-a09546c2-adc5-4da2-a4a3-231d7f8187e7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:54.351278 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-a09546c2-adc5-4da2-a4a3-231d7f8187e7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1521 microversion: 2.1 time: 0.157170 Jul 31 18:38:54.351843 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 120/227] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:54 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:55.374144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-e31dbc50-496b-4074-ab0f-005bb0f4e40b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:55.374761 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-e31dbc50-496b-4074-ab0f-005bb0f4e40b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:55.382588 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e31dbc50-496b-4074-ab0f-005bb0f4e40b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:55.383035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e31dbc50-496b-4074-ab0f-005bb0f4e40b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:55.383788 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e31dbc50-496b-4074-ab0f-005bb0f4e40b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:55.384215 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e31dbc50-496b-4074-ab0f-005bb0f4e40b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:55.526573 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-e31dbc50-496b-4074-ab0f-005bb0f4e40b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:55.534156 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-e31dbc50-496b-4074-ab0f-005bb0f4e40b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1521 microversion: 2.1 time: 0.165078 Jul 31 18:38:55.534716 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 108/228] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:55 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:56.555666 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-2b776905-edb9-4137-b0d3-865edeefbfbf tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:56.556447 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-2b776905-edb9-4137-b0d3-865edeefbfbf tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:56.562940 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2b776905-edb9-4137-b0d3-865edeefbfbf tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:56.563456 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2b776905-edb9-4137-b0d3-865edeefbfbf tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:56.564277 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2b776905-edb9-4137-b0d3-865edeefbfbf tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:56.564814 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2b776905-edb9-4137-b0d3-865edeefbfbf tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:56.710943 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-2b776905-edb9-4137-b0d3-865edeefbfbf tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:56.721881 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-2b776905-edb9-4137-b0d3-865edeefbfbf tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1521 microversion: 2.1 time: 0.170284 Jul 31 18:38:56.723261 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 121/229] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:56 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:57.744055 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-fc5873e5-3957-493f-a49a-fde266b444d7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:57.744687 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-fc5873e5-3957-493f-a49a-fde266b444d7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:57.750948 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-fc5873e5-3957-493f-a49a-fde266b444d7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:57.751476 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-fc5873e5-3957-493f-a49a-fde266b444d7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:57.752308 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-fc5873e5-3957-493f-a49a-fde266b444d7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:57.752826 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-fc5873e5-3957-493f-a49a-fde266b444d7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:57.894914 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-fc5873e5-3957-493f-a49a-fde266b444d7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:57.902833 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-fc5873e5-3957-493f-a49a-fde266b444d7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1521 microversion: 2.1 time: 0.163395 Jul 31 18:38:57.903405 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 109/230] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:57 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:38:58.923616 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-562595df-9b92-4816-ae75-120b471d204e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:38:58.924222 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-562595df-9b92-4816-ae75-120b471d204e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:38:58.931172 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-562595df-9b92-4816-ae75-120b471d204e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:58.931624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-562595df-9b92-4816-ae75-120b471d204e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:58.932403 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-562595df-9b92-4816-ae75-120b471d204e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:38:58.932859 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-562595df-9b92-4816-ae75-120b471d204e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:38:59.072840 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-562595df-9b92-4816-ae75-120b471d204e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:38:59.081293 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-562595df-9b92-4816-ae75-120b471d204e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1521 microversion: 2.1 time: 0.161334 Jul 31 18:38:59.082219 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 122/231] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:38:58 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:00.102617 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-692e9eef-464f-449c-9ef6-6f9aec34e152 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:00.103170 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-692e9eef-464f-449c-9ef6-6f9aec34e152 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:00.109942 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-692e9eef-464f-449c-9ef6-6f9aec34e152 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:00.110384 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-692e9eef-464f-449c-9ef6-6f9aec34e152 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:00.111128 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-692e9eef-464f-449c-9ef6-6f9aec34e152 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:00.111556 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-692e9eef-464f-449c-9ef6-6f9aec34e152 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:00.248657 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-692e9eef-464f-449c-9ef6-6f9aec34e152 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:00.256790 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-692e9eef-464f-449c-9ef6-6f9aec34e152 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1521 microversion: 2.1 time: 0.158188 Jul 31 18:39:00.257376 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 110/232] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:00 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:01.282321 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-9dd01f2a-15c6-425d-8fbb-f4c848f79cfa tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:01.283333 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-9dd01f2a-15c6-425d-8fbb-f4c848f79cfa tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:01.292010 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9dd01f2a-15c6-425d-8fbb-f4c848f79cfa tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:01.292446 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9dd01f2a-15c6-425d-8fbb-f4c848f79cfa tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:01.293248 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9dd01f2a-15c6-425d-8fbb-f4c848f79cfa tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:01.293680 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9dd01f2a-15c6-425d-8fbb-f4c848f79cfa tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:01.428447 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-9dd01f2a-15c6-425d-8fbb-f4c848f79cfa tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:01.437551 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-9dd01f2a-15c6-425d-8fbb-f4c848f79cfa tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1521 microversion: 2.1 time: 0.161401 Jul 31 18:39:01.438353 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 123/233] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:01 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:02.463527 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-7b9f7031-25f3-4c32-9256-a8099dcfea5e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:02.464178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-7b9f7031-25f3-4c32-9256-a8099dcfea5e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:02.470709 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7b9f7031-25f3-4c32-9256-a8099dcfea5e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:02.471156 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7b9f7031-25f3-4c32-9256-a8099dcfea5e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:02.471983 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7b9f7031-25f3-4c32-9256-a8099dcfea5e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:02.472412 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7b9f7031-25f3-4c32-9256-a8099dcfea5e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:02.609219 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-7b9f7031-25f3-4c32-9256-a8099dcfea5e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:02.618228 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-7b9f7031-25f3-4c32-9256-a8099dcfea5e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1521 microversion: 2.1 time: 0.161581 Jul 31 18:39:02.618774 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 111/234] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:02 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:03.644341 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f81be63f-1dbc-4de6-a979-39bbfdbd0a25 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:03.645203 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-f81be63f-1dbc-4de6-a979-39bbfdbd0a25 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:03.655449 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f81be63f-1dbc-4de6-a979-39bbfdbd0a25 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:03.655899 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f81be63f-1dbc-4de6-a979-39bbfdbd0a25 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:03.656665 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f81be63f-1dbc-4de6-a979-39bbfdbd0a25 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:03.657137 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f81be63f-1dbc-4de6-a979-39bbfdbd0a25 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:03.805325 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-f81be63f-1dbc-4de6-a979-39bbfdbd0a25 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:03.813402 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-f81be63f-1dbc-4de6-a979-39bbfdbd0a25 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1521 microversion: 2.1 time: 0.175763 Jul 31 18:39:03.814066 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 124/235] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:03 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:04.838951 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-4c0de187-69f9-4222-ab94-3dd43a96bfb4 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:04.840152 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-4c0de187-69f9-4222-ab94-3dd43a96bfb4 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:04.851263 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4c0de187-69f9-4222-ab94-3dd43a96bfb4 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:04.852242 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4c0de187-69f9-4222-ab94-3dd43a96bfb4 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:04.853619 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4c0de187-69f9-4222-ab94-3dd43a96bfb4 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:04.854424 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4c0de187-69f9-4222-ab94-3dd43a96bfb4 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:04.858167 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:04.997196 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-4c0de187-69f9-4222-ab94-3dd43a96bfb4 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:05.005253 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-4c0de187-69f9-4222-ab94-3dd43a96bfb4 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1521 microversion: 2.1 time: 0.172750 Jul 31 18:39:05.006352 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 112/236] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:04 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:06.029182 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-16ba7693-c27b-4391-a6eb-7e4d69c28f98 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:06.029760 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-16ba7693-c27b-4391-a6eb-7e4d69c28f98 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:06.036739 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-16ba7693-c27b-4391-a6eb-7e4d69c28f98 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:06.037229 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-16ba7693-c27b-4391-a6eb-7e4d69c28f98 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:06.038006 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-16ba7693-c27b-4391-a6eb-7e4d69c28f98 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:06.038526 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-16ba7693-c27b-4391-a6eb-7e4d69c28f98 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:06.171418 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-16ba7693-c27b-4391-a6eb-7e4d69c28f98 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:06.179051 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-16ba7693-c27b-4391-a6eb-7e4d69c28f98 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1521 microversion: 2.1 time: 0.154271 Jul 31 18:39:06.179622 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 125/237] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:06 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:06.848815 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-45049a11-68f1-41bb-9f48-8308b3c30f3a tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:06.849592 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-45049a11-68f1-41bb-9f48-8308b3c30f3a tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:06.859516 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-45049a11-68f1-41bb-9f48-8308b3c30f3a tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:06.860193 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-45049a11-68f1-41bb-9f48-8308b3c30f3a tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:06.861398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-45049a11-68f1-41bb-9f48-8308b3c30f3a tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:06.862053 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-45049a11-68f1-41bb-9f48-8308b3c30f3a tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:06.888818 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-45049a11-68f1-41bb-9f48-8308b3c30f3a tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92/ips" status: 200 len: 146 microversion: 2.1 time: 0.046012 Jul 31 18:39:06.889387 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 113/238] 10.222.0.49 () {58 vars in 1248 bytes} [Sun Jul 31 18:39:06 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92/ips => generated 146 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:39:07.148988 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-7620efc1-7ebd-454d-a418-7bcc87e9a00c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:07.149864 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-7620efc1-7ebd-454d-a418-7bcc87e9a00c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:07.161047 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7620efc1-7ebd-454d-a418-7bcc87e9a00c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:07.161803 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7620efc1-7ebd-454d-a418-7bcc87e9a00c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:07.163041 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7620efc1-7ebd-454d-a418-7bcc87e9a00c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:07.163774 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7620efc1-7ebd-454d-a418-7bcc87e9a00c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:07.189409 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-7620efc1-7ebd-454d-a418-7bcc87e9a00c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e/ips" status: 200 len: 150 microversion: 2.1 time: 0.047235 Jul 31 18:39:07.189976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 126/239] 10.222.0.49 () {58 vars in 1248 bytes} [Sun Jul 31 18:39:07 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:39:07.201151 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-bab25778-4317-4ffa-a2bd-87303a245aa9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:07.201755 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-bab25778-4317-4ffa-a2bd-87303a245aa9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:07.208338 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bab25778-4317-4ffa-a2bd-87303a245aa9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:07.208809 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bab25778-4317-4ffa-a2bd-87303a245aa9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:07.209753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bab25778-4317-4ffa-a2bd-87303a245aa9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:07.210215 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bab25778-4317-4ffa-a2bd-87303a245aa9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:07.363527 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-bab25778-4317-4ffa-a2bd-87303a245aa9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:07.372520 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-bab25778-4317-4ffa-a2bd-87303a245aa9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1521 microversion: 2.1 time: 0.175153 Jul 31 18:39:07.373194 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 114/240] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:07 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:08.395190 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-0a680604-883d-4cc2-acdb-3607e099cb4a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:08.395801 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-0a680604-883d-4cc2-acdb-3607e099cb4a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:08.402638 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0a680604-883d-4cc2-acdb-3607e099cb4a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:08.403196 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0a680604-883d-4cc2-acdb-3607e099cb4a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:08.403977 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0a680604-883d-4cc2-acdb-3607e099cb4a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:08.404530 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0a680604-883d-4cc2-acdb-3607e099cb4a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:08.405613 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-b4642684-2d38-4b63-9d28-1a2fdab00a1b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:08.406677 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-b4642684-2d38-4b63-9d28-1a2fdab00a1b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:08.413108 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b4642684-2d38-4b63-9d28-1a2fdab00a1b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:08.413625 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b4642684-2d38-4b63-9d28-1a2fdab00a1b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:08.414464 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b4642684-2d38-4b63-9d28-1a2fdab00a1b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:08.414959 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b4642684-2d38-4b63-9d28-1a2fdab00a1b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:08.439056 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-b4642684-2d38-4b63-9d28-1a2fdab00a1b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f/ips" status: 200 len: 151 microversion: 2.20 time: 0.037788 Jul 31 18:39:08.446457 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 115/241] 10.222.0.49 () {60 vars in 1289 bytes} [Sun Jul 31 18:39:08 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 18:39:08.554493 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-0a680604-883d-4cc2-acdb-3607e099cb4a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:08.563723 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-0a680604-883d-4cc2-acdb-3607e099cb4a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1521 microversion: 2.1 time: 0.172863 Jul 31 18:39:08.577656 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 127/242] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:08 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:08.599028 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-ba1f6f45-a4a8-4fc8-9141-5994a97066f3 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b23b2516-c7bb-472c-a952-e2eab84172db"}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:08.601338 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-ba1f6f45-a4a8-4fc8-9141-5994a97066f3 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:08.607325 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ba1f6f45-a4a8-4fc8-9141-5994a97066f3 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:08.607759 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ba1f6f45-a4a8-4fc8-9141-5994a97066f3 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:08.608906 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ba1f6f45-a4a8-4fc8-9141-5994a97066f3 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:08.609473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ba1f6f45-a4a8-4fc8-9141-5994a97066f3 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:08.941294 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-ba1f6f45-a4a8-4fc8-9141-5994a97066f3 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "POST /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.346212 Jul 31 18:39:08.941971 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 116/243] 10.222.0.49 () {60 vars in 1323 bytes} [Sun Jul 31 18:39:08 2022] POST /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e/os-volume_attachments => generated 194 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:39:09.586514 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-28a4adec-cc37-400d-abb6-1adb353999dc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:09.587145 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-28a4adec-cc37-400d-abb6-1adb353999dc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:09.594209 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-28a4adec-cc37-400d-abb6-1adb353999dc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:09.594654 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-28a4adec-cc37-400d-abb6-1adb353999dc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:09.595448 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-28a4adec-cc37-400d-abb6-1adb353999dc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:09.595890 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-28a4adec-cc37-400d-abb6-1adb353999dc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:09.875916 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-28a4adec-cc37-400d-abb6-1adb353999dc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:09.884795 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-28a4adec-cc37-400d-abb6-1adb353999dc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1521 microversion: 2.1 time: 0.302224 Jul 31 18:39:09.885481 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 128/244] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:09 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:10.906843 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-46b1beac-05be-4557-b6b3-e7feef76432f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:10.907698 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-46b1beac-05be-4557-b6b3-e7feef76432f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:10.911027 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=32 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:10.917036 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-46b1beac-05be-4557-b6b3-e7feef76432f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:10.917584 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-46b1beac-05be-4557-b6b3-e7feef76432f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:10.918401 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-46b1beac-05be-4557-b6b3-e7feef76432f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:10.918967 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-46b1beac-05be-4557-b6b3-e7feef76432f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:10.957851 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-486e0163-bce3-47f3-86d0-bda0e80a0d87 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:10.958459 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-486e0163-bce3-47f3-86d0-bda0e80a0d87 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:10.967931 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-486e0163-bce3-47f3-86d0-bda0e80a0d87 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:10.968400 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-486e0163-bce3-47f3-86d0-bda0e80a0d87 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:10.973114 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-486e0163-bce3-47f3-86d0-bda0e80a0d87 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:10.973561 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-486e0163-bce3-47f3-86d0-bda0e80a0d87 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:11.001897 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.objects.instance [None req-486e0163-bce3-47f3-86d0-bda0e80a0d87 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lazy-loading 'flavor' on Instance uuid 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f {{(pid=124334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:39:11.070022 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-46b1beac-05be-4557-b6b3-e7feef76432f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:11.090754 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-46b1beac-05be-4557-b6b3-e7feef76432f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1521 microversion: 2.1 time: 0.188099 Jul 31 18:39:11.097867 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 117/245] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:10 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:11.280003 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-486e0163-bce3-47f3-86d0-bda0e80a0d87 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "POST /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f/action" status: 202 len: 0 microversion: 2.20 time: 0.326536 Jul 31 18:39:11.280724 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 129/246] 10.222.0.49 () {62 vars in 1319 bytes} [Sun Jul 31 18:39:10 2022] POST /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 18:39:11.294187 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-ce685ef9-065e-4843-8622-0685c47c7ac8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:11.295036 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-ce685ef9-065e-4843-8622-0685c47c7ac8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:11.303390 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ce685ef9-065e-4843-8622-0685c47c7ac8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:11.303834 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ce685ef9-065e-4843-8622-0685c47c7ac8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:11.304616 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ce685ef9-065e-4843-8622-0685c47c7ac8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:11.305073 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ce685ef9-065e-4843-8622-0685c47c7ac8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:11.427644 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-c39cb88c-8693-4b4b-b221-f72e6658d2b4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f59a45d-f921-49cd-8dfe-17ce11dbdac0"}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:11.432281 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-c39cb88c-8693-4b4b-b221-f72e6658d2b4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:11.439234 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c39cb88c-8693-4b4b-b221-f72e6658d2b4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:11.439700 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c39cb88c-8693-4b4b-b221-f72e6658d2b4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:11.440501 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c39cb88c-8693-4b4b-b221-f72e6658d2b4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:11.441102 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c39cb88c-8693-4b4b-b221-f72e6658d2b4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:11.463799 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-ce685ef9-065e-4843-8622-0685c47c7ac8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:11.474487 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-ce685ef9-065e-4843-8622-0685c47c7ac8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:11.475725 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-ce685ef9-065e-4843-8622-0685c47c7ac8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:11.476916 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-ce685ef9-065e-4843-8622-0685c47c7ac8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1723 microversion: 2.20 time: 0.191509 Jul 31 18:39:11.477485 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 118/247] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:11 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:11.589433 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:11.733796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-c39cb88c-8693-4b4b-b221-f72e6658d2b4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "POST /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309958 Jul 31 18:39:11.734722 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 130/248] 10.222.0.49 () {60 vars in 1323 bytes} [Sun Jul 31 18:39:11 2022] POST /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:39:12.118998 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-6c6bb86a-04df-481a-a451-e536ffe26898 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:12.120212 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-6c6bb86a-04df-481a-a451-e536ffe26898 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:12.127257 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6c6bb86a-04df-481a-a451-e536ffe26898 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:12.127707 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6c6bb86a-04df-481a-a451-e536ffe26898 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:12.128881 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6c6bb86a-04df-481a-a451-e536ffe26898 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:12.129316 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6c6bb86a-04df-481a-a451-e536ffe26898 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:12.264672 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-6c6bb86a-04df-481a-a451-e536ffe26898 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:12.272691 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-6c6bb86a-04df-481a-a451-e536ffe26898 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1521 microversion: 2.1 time: 0.157620 Jul 31 18:39:12.273323 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 119/249] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:12 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:12.501718 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-58f55cf6-78e2-4c99-a84b-8ecc7bf56f73 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:12.502759 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-58f55cf6-78e2-4c99-a84b-8ecc7bf56f73 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:12.510321 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-58f55cf6-78e2-4c99-a84b-8ecc7bf56f73 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:12.510789 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-58f55cf6-78e2-4c99-a84b-8ecc7bf56f73 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:12.511569 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-58f55cf6-78e2-4c99-a84b-8ecc7bf56f73 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:12.512039 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-58f55cf6-78e2-4c99-a84b-8ecc7bf56f73 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:12.647521 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-58f55cf6-78e2-4c99-a84b-8ecc7bf56f73 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:12.655959 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-58f55cf6-78e2-4c99-a84b-8ecc7bf56f73 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:12.657482 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-58f55cf6-78e2-4c99-a84b-8ecc7bf56f73 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:12.658650 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-58f55cf6-78e2-4c99-a84b-8ecc7bf56f73 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1723 microversion: 2.20 time: 0.162120 Jul 31 18:39:12.659211 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 131/250] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:12 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 18:39:13.293693 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-1ffe0989-eb19-4f45-b94e-f4cae4e8e6fc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:13.294302 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-1ffe0989-eb19-4f45-b94e-f4cae4e8e6fc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:13.301083 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1ffe0989-eb19-4f45-b94e-f4cae4e8e6fc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:13.301558 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1ffe0989-eb19-4f45-b94e-f4cae4e8e6fc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:13.302381 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1ffe0989-eb19-4f45-b94e-f4cae4e8e6fc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:13.302806 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1ffe0989-eb19-4f45-b94e-f4cae4e8e6fc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:13.436696 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-1ffe0989-eb19-4f45-b94e-f4cae4e8e6fc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:13.444601 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-1ffe0989-eb19-4f45-b94e-f4cae4e8e6fc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1521 microversion: 2.1 time: 0.154974 Jul 31 18:39:13.445218 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 120/251] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:13 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:13.682239 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-38b76a60-d909-497b-848c-780fe07a3532 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:13.682826 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-38b76a60-d909-497b-848c-780fe07a3532 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:13.690757 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-38b76a60-d909-497b-848c-780fe07a3532 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:13.691374 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-38b76a60-d909-497b-848c-780fe07a3532 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:13.692533 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-38b76a60-d909-497b-848c-780fe07a3532 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:13.693162 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-38b76a60-d909-497b-848c-780fe07a3532 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:13.841911 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-38b76a60-d909-497b-848c-780fe07a3532 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:13.850014 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-38b76a60-d909-497b-848c-780fe07a3532 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:13.851511 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-38b76a60-d909-497b-848c-780fe07a3532 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:13.852656 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-38b76a60-d909-497b-848c-780fe07a3532 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1723 microversion: 2.20 time: 0.174378 Jul 31 18:39:13.853261 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 132/252] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:13 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:14.465244 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-b6cccc50-a497-425f-8d43-553784b594b7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:14.465955 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-b6cccc50-a497-425f-8d43-553784b594b7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:14.472956 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b6cccc50-a497-425f-8d43-553784b594b7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:14.473412 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b6cccc50-a497-425f-8d43-553784b594b7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:14.474180 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b6cccc50-a497-425f-8d43-553784b594b7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:14.474619 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b6cccc50-a497-425f-8d43-553784b594b7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:14.612545 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-b6cccc50-a497-425f-8d43-553784b594b7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:14.620405 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-b6cccc50-a497-425f-8d43-553784b594b7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1521 microversion: 2.1 time: 0.159068 Jul 31 18:39:14.621341 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 121/253] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:14 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:14.877842 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-18b3317b-7d7b-468f-8590-ece4f8b0ee27 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:14.879064 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-18b3317b-7d7b-468f-8590-ece4f8b0ee27 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:14.888020 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-18b3317b-7d7b-468f-8590-ece4f8b0ee27 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:14.888634 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-18b3317b-7d7b-468f-8590-ece4f8b0ee27 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:14.889411 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-18b3317b-7d7b-468f-8590-ece4f8b0ee27 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:14.889855 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-18b3317b-7d7b-468f-8590-ece4f8b0ee27 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:15.026073 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-18b3317b-7d7b-468f-8590-ece4f8b0ee27 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:15.034311 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-18b3317b-7d7b-468f-8590-ece4f8b0ee27 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:15.035870 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-18b3317b-7d7b-468f-8590-ece4f8b0ee27 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:15.037064 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-18b3317b-7d7b-468f-8590-ece4f8b0ee27 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1723 microversion: 2.20 time: 0.164343 Jul 31 18:39:15.037631 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 133/254] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:14 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:15.644497 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-9a3fb6d2-eb84-4cfd-b1ed-dd07b4c965b9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:15.645169 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-9a3fb6d2-eb84-4cfd-b1ed-dd07b4c965b9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:15.655340 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9a3fb6d2-eb84-4cfd-b1ed-dd07b4c965b9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:15.655780 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9a3fb6d2-eb84-4cfd-b1ed-dd07b4c965b9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:15.656872 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9a3fb6d2-eb84-4cfd-b1ed-dd07b4c965b9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:15.657556 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9a3fb6d2-eb84-4cfd-b1ed-dd07b4c965b9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:15.796821 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-9a3fb6d2-eb84-4cfd-b1ed-dd07b4c965b9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:15.804862 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-9a3fb6d2-eb84-4cfd-b1ed-dd07b4c965b9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1521 microversion: 2.1 time: 0.163894 Jul 31 18:39:15.804958 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 122/255] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:15 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:16.060477 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f20d1ce5-3cdc-406c-a859-7ca3e0606f45 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:16.061099 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-f20d1ce5-3cdc-406c-a859-7ca3e0606f45 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:16.069675 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f20d1ce5-3cdc-406c-a859-7ca3e0606f45 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:16.070420 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f20d1ce5-3cdc-406c-a859-7ca3e0606f45 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:16.071636 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f20d1ce5-3cdc-406c-a859-7ca3e0606f45 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:16.072319 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f20d1ce5-3cdc-406c-a859-7ca3e0606f45 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:16.209129 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-f20d1ce5-3cdc-406c-a859-7ca3e0606f45 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:16.220016 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-f20d1ce5-3cdc-406c-a859-7ca3e0606f45 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:16.221562 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-f20d1ce5-3cdc-406c-a859-7ca3e0606f45 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:16.223066 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-f20d1ce5-3cdc-406c-a859-7ca3e0606f45 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1723 microversion: 2.20 time: 0.166190 Jul 31 18:39:16.224271 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 134/256] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:16 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:16.534483 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-bfd2ce42-9321-4245-95c4-25d65825d8fc tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Action: 'create', calling method: .version_select at 0x7f870a241e50>, body: {"keypair": {"name": "tempest-keypair-1860128423", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxyQmTSnR4V6X0is9ckDk8hK7ZjJ52RFBzwXrVNsq9pCZSw8EcC43LDaxLsO9dFNCubloV26Xn7MdkLNi4MlgbDjQCD6P65DWc+HRZ4SicAZAnno6qjweMli64uVUXm4w=="}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:16.551373 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-bfd2ce42-9321-4245-95c4-25d65825d8fc tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Getting quotas for project 8b2df629457c4ff68ad061eb29cb232f. Resources: {'key_pairs'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:39:16.555537 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-bfd2ce42-9321-4245-95c4-25d65825d8fc tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Getting quotas for user 88472fa130654657af599106c6aac279 and project 8b2df629457c4ff68ad061eb29cb232f. Resources: {'key_pairs'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:39:16.583918 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-bfd2ce42-9321-4245-95c4-25d65825d8fc tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053058 Jul 31 18:39:16.584536 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 123/257] 10.222.0.49 () {60 vars in 1159 bytes} [Sun Jul 31 18:39:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:39:16.827222 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-e4700063-8698-477b-8aa9-53ddfc830063 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:16.827628 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-e4700063-8698-477b-8aa9-53ddfc830063 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:16.838920 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=38 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:16.841280 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e4700063-8698-477b-8aa9-53ddfc830063 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:16.841759 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e4700063-8698-477b-8aa9-53ddfc830063 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:16.842823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e4700063-8698-477b-8aa9-53ddfc830063 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:16.845351 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e4700063-8698-477b-8aa9-53ddfc830063 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:17.028436 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-e4700063-8698-477b-8aa9-53ddfc830063 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:17.037224 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-e4700063-8698-477b-8aa9-53ddfc830063 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1521 microversion: 2.1 time: 0.214998 Jul 31 18:39:17.037517 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 135/258] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:16 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:17.252225 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-e9bdd6e8-1899-46c1-ae24-247877065ffe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:17.253400 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-e9bdd6e8-1899-46c1-ae24-247877065ffe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:17.259885 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e9bdd6e8-1899-46c1-ae24-247877065ffe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:17.260524 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e9bdd6e8-1899-46c1-ae24-247877065ffe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:17.261515 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e9bdd6e8-1899-46c1-ae24-247877065ffe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:17.261946 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e9bdd6e8-1899-46c1-ae24-247877065ffe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:17.482341 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-e9bdd6e8-1899-46c1-ae24-247877065ffe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:17.490861 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-e9bdd6e8-1899-46c1-ae24-247877065ffe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:17.492582 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-e9bdd6e8-1899-46c1-ae24-247877065ffe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:17.493860 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-e9bdd6e8-1899-46c1-ae24-247877065ffe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1723 microversion: 2.20 time: 0.246242 Jul 31 18:39:17.494493 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 124/259] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:17 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:18.058257 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-22e519d2-b207-45e8-905f-481e87e2e8d7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:18.058815 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-22e519d2-b207-45e8-905f-481e87e2e8d7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:18.067226 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-22e519d2-b207-45e8-905f-481e87e2e8d7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:18.067672 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-22e519d2-b207-45e8-905f-481e87e2e8d7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:18.068445 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-22e519d2-b207-45e8-905f-481e87e2e8d7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:18.068905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-22e519d2-b207-45e8-905f-481e87e2e8d7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:18.234478 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-22e519d2-b207-45e8-905f-481e87e2e8d7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:18.242869 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-22e519d2-b207-45e8-905f-481e87e2e8d7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1521 microversion: 2.1 time: 0.188586 Jul 31 18:39:18.243383 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 136/260] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:18 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:18.497634 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-e2bac020-3e67-467a-a5ee-ac27ce6d3285 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1027821001", "imageRef": "6f2a0bb6-2fb3-4536-bee3-23e4e975f079", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf14a566-5800-492e-9819-b36a005e1f98"}], "security_groups": [{"name": "tempest-securitygroup--1611501702"}], "key_name": "tempest-keypair-1860128423", "user_data": "}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:18.518289 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-3dcad135-1cd4-4114-97b0-732702506b83 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:18.518925 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-3dcad135-1cd4-4114-97b0-732702506b83 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:18.525627 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3dcad135-1cd4-4114-97b0-732702506b83 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:18.526064 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3dcad135-1cd4-4114-97b0-732702506b83 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:18.526862 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3dcad135-1cd4-4114-97b0-732702506b83 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:18.527287 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3dcad135-1cd4-4114-97b0-732702506b83 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:18.607652 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.network.neutron [None req-e2bac020-3e67-467a-a5ee-ac27ce6d3285 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] validate_networks() for [('cf14a566-5800-492e-9819-b36a005e1f98', None, None, None, None, None)] {{(pid=124333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 18:39:18.665217 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-3dcad135-1cd4-4114-97b0-732702506b83 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:18.673729 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-3dcad135-1cd4-4114-97b0-732702506b83 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:18.675230 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-3dcad135-1cd4-4114-97b0-732702506b83 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:18.676406 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-3dcad135-1cd4-4114-97b0-732702506b83 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1723 microversion: 2.20 time: 0.162176 Jul 31 18:39:18.677156 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 137/261] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:18 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:19.183208 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-e2bac020-3e67-467a-a5ee-ac27ce6d3285 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Flavor limits 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 18:39:19.183717 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-e2bac020-3e67-467a-a5ee-ac27ce6d3285 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Image limits 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 18:39:19.184262 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-e2bac020-3e67-467a-a5ee-ac27ce6d3285 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Flavor pref 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 18:39:19.184729 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-e2bac020-3e67-467a-a5ee-ac27ce6d3285 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Image pref 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 18:39:19.185227 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-e2bac020-3e67-467a-a5ee-ac27ce6d3285 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 18:39:19.195479 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e2bac020-3e67-467a-a5ee-ac27ce6d3285 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:19.196085 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e2bac020-3e67-467a-a5ee-ac27ce6d3285 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:19.197142 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e2bac020-3e67-467a-a5ee-ac27ce6d3285 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:19.197788 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e2bac020-3e67-467a-a5ee-ac27ce6d3285 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:19.215788 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-e2bac020-3e67-467a-a5ee-ac27ce6d3285 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Getting quotas for project 8b2df629457c4ff68ad061eb29cb232f. Resources: {'cores', 'ram', 'instances'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:39:19.227259 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-e2bac020-3e67-467a-a5ee-ac27ce6d3285 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Getting quotas for user 88472fa130654657af599106c6aac279 and project 8b2df629457c4ff68ad061eb29cb232f. Resources: {'cores', 'ram', 'instances'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:39:19.242933 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-e2bac020-3e67-467a-a5ee-ac27ce6d3285 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Going to run 1 instances... {{(pid=124333) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 18:39:19.246192 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-e2bac020-3e67-467a-a5ee-ac27ce6d3285 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 8ccfba99-9116-4274-a24e-1615c1a661fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f2a0bb6-2fb3-4536-bee3-23e4e975f079',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 18:39:19.266356 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-2638c24a-267a-406c-af08-ef2048524d09 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:19.267745 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-2638c24a-267a-406c-af08-ef2048524d09 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:19.276161 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2638c24a-267a-406c-af08-ef2048524d09 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:19.276616 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2638c24a-267a-406c-af08-ef2048524d09 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:19.277420 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2638c24a-267a-406c-af08-ef2048524d09 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:19.277866 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2638c24a-267a-406c-af08-ef2048524d09 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:19.346947 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-e2bac020-3e67-467a-a5ee-ac27ce6d3285 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.853652 Jul 31 18:39:19.348014 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 125/262] 10.222.0.49 () {60 vars in 1147 bytes} [Sun Jul 31 18:39:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 18:39:19.360787 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-78cecae1-4eea-4c08-b86b-7ac8e645f561 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:19.361529 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-78cecae1-4eea-4c08-b86b-7ac8e645f561 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 8ccfba99-9116-4274-a24e-1615c1a661fa] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:19.424462 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-78cecae1-4eea-4c08-b86b-7ac8e645f561 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:19.437389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-78cecae1-4eea-4c08-b86b-7ac8e645f561 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa" status: 200 len: 1242 microversion: 2.1 time: 0.081842 Jul 31 18:39:19.450202 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 126/263] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:19 2022] GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:19.450383 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-2638c24a-267a-406c-af08-ef2048524d09 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:19.458883 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-2638c24a-267a-406c-af08-ef2048524d09 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1501 microversion: 2.1 time: 0.197919 Jul 31 18:39:19.461429 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 138/264] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:19 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1501 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:39:19.482705 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-4bc13071-908c-4802-8d1d-d0db261de75e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81a5b548-e888-4f8e-b62d-e1bbb3c090f6"}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:19.486082 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-4bc13071-908c-4802-8d1d-d0db261de75e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:19.493384 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4bc13071-908c-4802-8d1d-d0db261de75e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:19.494098 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4bc13071-908c-4802-8d1d-d0db261de75e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:19.494937 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4bc13071-908c-4802-8d1d-d0db261de75e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:19.495603 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4bc13071-908c-4802-8d1d-d0db261de75e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:19.521481 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-4bc13071-908c-4802-8d1d-d0db261de75e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] HTTP exception thrown: Cannot 'attach_volume' instance 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c while it is in vm_state rescued Jul 31 18:39:19.523162 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-4bc13071-908c-4802-8d1d-d0db261de75e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Request method failure captured: Jul 31 18:39:19.523162 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: POST /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c/os-volume_attachments HTTP/1.1 Jul 31 18:39:19.523162 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:39:19.523162 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:39:19.523162 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:39:19.523162 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 74 Jul 31 18:39:19.523162 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:39:19.523162 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:39:19.523162 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:39:19.523162 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:39:19.523162 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5svqlSgAB4kxDyQMdh6aFEcG7207X-UJC0pKHGAD88jUgWbbHA6dn_dW8BxMSIO-xgFN0o9hHxSIysSfnyB4V_TuR2QA6dHUqROz7OQx54TYPajwpKM0xUhk144NLdqXybv-XuN5zssUIo7q5QZ5Kvc-1-m2LH7B1BXkySwY7cMaByk Jul 31 18:39:19.523162 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:39:19.523162 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:39:19.523162 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:39:19.523162 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:39:19.523162 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:39:19.523162 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:39:19.523162 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: df42ccb208664e04ac753b0c64b4fab7 Jul 31 18:39:19.523162 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599579080 Jul 31 18:39:19.523162 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:39:19.523162 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:39:19.524324 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/df42ccb208664e04ac753b0c64b4fab7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_df42ccb208664e04ac753b0c64b4fab7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/df42ccb208664e04ac753b0c64b4fab7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/df42ccb208664e04ac753b0c64b4fab7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:39:19.524324 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599579080 Jul 31 18:39:19.524324 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: df42ccb208664e04ac753b0c64b4fab7 Jul 31 18:39:19.524324 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599579080 Jul 31 18:39:19.524324 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-ServerRescueNegativeTestJSON-1599579080-project Jul 31 18:39:19.524324 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:39:19.524324 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:39:19.524324 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 0d7ed577305d48c795f280e49b438bfc Jul 31 18:39:19.524324 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599579080-project Jul 31 18:39:19.524324 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Jul 31 18:39:19.524324 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {"volumeAttachment": {"volumeId": "81a5b548-e888-4f8e-b62d-e1bbb3c090f6"}} Jul 31 18:39:19.524324 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: > Jul 31 18:39:19.525023 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Cannot 'attach_volume' instance 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c while it is in vm_state rescued Jul 31 18:39:19.525023 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'server_id': '4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c', 'body': {'volumeAttachment': {'volumeId': '81a5b548-e888-4f8e-b62d-e1bbb3c090f6'}}} Jul 31 18:39:19.525023 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:39:19.525023 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:39:19.525023 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 31 18:39:19.525023 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 31 18:39:19.525023 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 18:39:19.525023 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 18:39:19.525023 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 31 18:39:19.525023 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 31 18:39:19.525023 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 31 18:39:19.525023 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:39:19.525023 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:39:19.525023 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:39:19.525023 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:39:19.525023 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:39:19.525023 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:39:19.525023 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:39:19.525023 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:39:19.526496 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:39:19.526496 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:39:19.526496 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 18:39:19.526496 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 18:39:19.526496 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 18:39:19.526496 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 18:39:19.526496 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 18:39:19.526496 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 18:39:19.526496 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 31 18:39:19.526496 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 31 18:39:19.526496 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 31 18:39:19.526496 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 31 18:39:19.526496 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c while it is in vm_state rescued Jul 31 18:39:19.526496 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:39:19.526496 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:39:19.526496 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:39:19.526496 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:39:19.526496 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:39:19.526496 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:39:19.529013 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:39:19.529013 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:39:19.529013 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c while it is in vm_state rescued Jul 31 18:39:19.529013 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:39:19.529013 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-4bc13071-908c-4802-8d1d-d0db261de75e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Returning 409 to user: Cannot 'attach_volume' instance 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c while it is in vm_state rescued {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:39:19.529013 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-4bc13071-908c-4802-8d1d-d0db261de75e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "POST /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048397 Jul 31 18:39:19.532858 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 127/265] 10.222.0.49 () {60 vars in 1323 bytes} [Sun Jul 31 18:39:19 2022] POST /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c/os-volume_attachments => generated 152 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 31 18:39:19.533943 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-542571b0-7724-4a8d-a11e-0296bc403404 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:19.534485 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-542571b0-7724-4a8d-a11e-0296bc403404 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:19.540893 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-542571b0-7724-4a8d-a11e-0296bc403404 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:19.541353 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-542571b0-7724-4a8d-a11e-0296bc403404 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:19.542129 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-542571b0-7724-4a8d-a11e-0296bc403404 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:19.542566 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-542571b0-7724-4a8d-a11e-0296bc403404 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:19.626596 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-542571b0-7724-4a8d-a11e-0296bc403404 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "POST /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c/action" status: 202 len: 0 microversion: 2.1 time: 0.096236 Jul 31 18:39:19.627628 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 139/266] 10.222.0.49 () {60 vars in 1278 bytes} [Sun Jul 31 18:39:19 2022] POST /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:39:19.636049 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-a2f9e71c-9db0-41d7-b320-2e4a698d7100 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:19.636660 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-a2f9e71c-9db0-41d7-b320-2e4a698d7100 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:19.643206 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a2f9e71c-9db0-41d7-b320-2e4a698d7100 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:19.643915 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a2f9e71c-9db0-41d7-b320-2e4a698d7100 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:19.644692 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a2f9e71c-9db0-41d7-b320-2e4a698d7100 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:19.645130 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a2f9e71c-9db0-41d7-b320-2e4a698d7100 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:19.704718 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-28975e6a-d9fa-4db0-b304-a60a63459921 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:19.705767 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-28975e6a-d9fa-4db0-b304-a60a63459921 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:19.715486 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-28975e6a-d9fa-4db0-b304-a60a63459921 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:19.716225 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-28975e6a-d9fa-4db0-b304-a60a63459921 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:19.717542 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-28975e6a-d9fa-4db0-b304-a60a63459921 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:19.718377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-28975e6a-d9fa-4db0-b304-a60a63459921 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:19.923847 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-28975e6a-d9fa-4db0-b304-a60a63459921 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:19.936755 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-28975e6a-d9fa-4db0-b304-a60a63459921 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:19.936755 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-28975e6a-d9fa-4db0-b304-a60a63459921 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:19.938219 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-28975e6a-d9fa-4db0-b304-a60a63459921 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1723 microversion: 2.20 time: 0.241167 Jul 31 18:39:19.939637 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 140/267] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:19 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 18:39:19.955867 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-a2f9e71c-9db0-41d7-b320-2e4a698d7100 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:19.966320 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-a2f9e71c-9db0-41d7-b320-2e4a698d7100 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1509 microversion: 2.1 time: 0.334073 Jul 31 18:39:19.967165 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 128/268] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:19 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1509 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:39:20.458290 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-fffc40c1-b147-4733-95b0-14606f62c786 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:20.458961 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-fffc40c1-b147-4733-95b0-14606f62c786 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 8ccfba99-9116-4274-a24e-1615c1a661fa] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:20.470399 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fffc40c1-b147-4733-95b0-14606f62c786 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:20.470849 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fffc40c1-b147-4733-95b0-14606f62c786 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:20.471832 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fffc40c1-b147-4733-95b0-14606f62c786 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:20.472282 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fffc40c1-b147-4733-95b0-14606f62c786 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:20.549917 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-fffc40c1-b147-4733-95b0-14606f62c786 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:20.559987 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-fffc40c1-b147-4733-95b0-14606f62c786 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa" status: 200 len: 1294 microversion: 2.1 time: 0.105325 Jul 31 18:39:20.561154 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 141/269] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:20 2022] GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa => generated 1294 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:20.964089 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-b6de258e-8906-45c2-8dfc-98a968b89717 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:20.965500 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-b6de258e-8906-45c2-8dfc-98a968b89717 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:20.973856 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b6de258e-8906-45c2-8dfc-98a968b89717 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:20.974691 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b6de258e-8906-45c2-8dfc-98a968b89717 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:20.975852 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b6de258e-8906-45c2-8dfc-98a968b89717 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:20.976507 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b6de258e-8906-45c2-8dfc-98a968b89717 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:20.987753 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-da21bace-bd66-4507-98f4-41f9d61d7e97 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:20.989023 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-da21bace-bd66-4507-98f4-41f9d61d7e97 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:20.998136 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-da21bace-bd66-4507-98f4-41f9d61d7e97 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:20.998711 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-da21bace-bd66-4507-98f4-41f9d61d7e97 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:20.999726 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-da21bace-bd66-4507-98f4-41f9d61d7e97 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:21.000353 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-da21bace-bd66-4507-98f4-41f9d61d7e97 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:21.181060 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-da21bace-bd66-4507-98f4-41f9d61d7e97 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:21.193568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-da21bace-bd66-4507-98f4-41f9d61d7e97 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1509 microversion: 2.1 time: 0.209706 Jul 31 18:39:21.199858 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-b6de258e-8906-45c2-8dfc-98a968b89717 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:21.209242 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 142/270] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:20 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1509 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:39:21.214255 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-b6de258e-8906-45c2-8dfc-98a968b89717 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:21.215739 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-b6de258e-8906-45c2-8dfc-98a968b89717 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:21.217212 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-b6de258e-8906-45c2-8dfc-98a968b89717 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1723 microversion: 2.20 time: 0.257791 Jul 31 18:39:21.219428 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 129/271] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:20 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:21.582125 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-fb2e3c6a-55d9-465c-9822-79fc028a0d5a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:21.584013 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-fb2e3c6a-55d9-465c-9822-79fc028a0d5a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 8ccfba99-9116-4274-a24e-1615c1a661fa] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:21.591371 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fb2e3c6a-55d9-465c-9822-79fc028a0d5a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:21.592149 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fb2e3c6a-55d9-465c-9822-79fc028a0d5a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:21.593674 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fb2e3c6a-55d9-465c-9822-79fc028a0d5a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:21.594305 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fb2e3c6a-55d9-465c-9822-79fc028a0d5a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:21.745837 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-fb2e3c6a-55d9-465c-9822-79fc028a0d5a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:21.754038 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-fb2e3c6a-55d9-465c-9822-79fc028a0d5a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa" status: 200 len: 1368 microversion: 2.1 time: 0.175921 Jul 31 18:39:21.754589 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 143/272] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:21 2022] GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:39:22.215298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-164a2273-976d-4a90-8a1c-22b00e68f5d9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:22.215910 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-164a2273-976d-4a90-8a1c-22b00e68f5d9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:22.222634 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-164a2273-976d-4a90-8a1c-22b00e68f5d9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:22.223095 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-164a2273-976d-4a90-8a1c-22b00e68f5d9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:22.223868 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-164a2273-976d-4a90-8a1c-22b00e68f5d9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:22.224269 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-164a2273-976d-4a90-8a1c-22b00e68f5d9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:22.241721 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-c7475ffa-a327-44b8-938f-c49e915d59ce tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:22.242429 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-c7475ffa-a327-44b8-938f-c49e915d59ce tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:22.248668 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c7475ffa-a327-44b8-938f-c49e915d59ce tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:22.249224 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c7475ffa-a327-44b8-938f-c49e915d59ce tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:22.250071 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c7475ffa-a327-44b8-938f-c49e915d59ce tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:22.250578 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c7475ffa-a327-44b8-938f-c49e915d59ce tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:22.411746 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-c7475ffa-a327-44b8-938f-c49e915d59ce tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:22.419904 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-c7475ffa-a327-44b8-938f-c49e915d59ce tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:22.421744 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-c7475ffa-a327-44b8-938f-c49e915d59ce tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:22.423223 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-c7475ffa-a327-44b8-938f-c49e915d59ce tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1723 microversion: 2.20 time: 0.185608 Jul 31 18:39:22.424008 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 144/273] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:22 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:22.441701 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-164a2273-976d-4a90-8a1c-22b00e68f5d9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:22.449600 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-164a2273-976d-4a90-8a1c-22b00e68f5d9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1509 microversion: 2.1 time: 0.238178 Jul 31 18:39:22.461566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 130/274] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:22 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1509 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:22.777879 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-1bdacb58-1c2c-46cf-9c20-6b1079222ef9 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:22.779489 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-1bdacb58-1c2c-46cf-9c20-6b1079222ef9 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 8ccfba99-9116-4274-a24e-1615c1a661fa] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:22.790721 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1bdacb58-1c2c-46cf-9c20-6b1079222ef9 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:22.791586 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1bdacb58-1c2c-46cf-9c20-6b1079222ef9 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:22.792858 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1bdacb58-1c2c-46cf-9c20-6b1079222ef9 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:22.793597 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1bdacb58-1c2c-46cf-9c20-6b1079222ef9 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:22.818882 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:22.974148 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-f656c245-fc6e-401d-add5-658e9536d0dc req-2756cfb2-7d45-499e-a6b0-1d89ad1b9d52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ccfba99-9116-4274-a24e-1615c1a661fa", "tag": "2900adf5-d18f-4ff5-81c3-7e992ab7af76"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:22.984641 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-f656c245-fc6e-401d-add5-658e9536d0dc req-2756cfb2-7d45-499e-a6b0-1d89ad1b9d52 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:22.985374 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-f656c245-fc6e-401d-add5-658e9536d0dc req-2756cfb2-7d45-499e-a6b0-1d89ad1b9d52 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:22.989793 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-1bdacb58-1c2c-46cf-9c20-6b1079222ef9 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:22.990521 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:22.999349 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-f656c245-fc6e-401d-add5-658e9536d0dc req-2756cfb2-7d45-499e-a6b0-1d89ad1b9d52 service nova] Creating event network-changed:2900adf5-d18f-4ff5-81c3-7e992ab7af76 for instance 8ccfba99-9116-4274-a24e-1615c1a661fa on hv-cinder-84984 Jul 31 18:39:23.006867 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-f656c245-fc6e-401d-add5-658e9536d0dc req-2756cfb2-7d45-499e-a6b0-1d89ad1b9d52 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036875 Jul 31 18:39:23.008105 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-1bdacb58-1c2c-46cf-9c20-6b1079222ef9 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa" status: 200 len: 1368 microversion: 2.1 time: 0.236351 Jul 31 18:39:23.008249 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 131/275] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:39:23.016284 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 145/276] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:22 2022] GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa => generated 1368 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:23.448212 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-36290010-c150-45fe-8683-c4db7ae5c332 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:23.449148 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-36290010-c150-45fe-8683-c4db7ae5c332 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:23.457276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-36290010-c150-45fe-8683-c4db7ae5c332 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:23.457720 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-36290010-c150-45fe-8683-c4db7ae5c332 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:23.458516 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-36290010-c150-45fe-8683-c4db7ae5c332 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:23.458931 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-36290010-c150-45fe-8683-c4db7ae5c332 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:23.471904 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-00147870-8519-4001-a7c5-02c2d107eeb3 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:23.472883 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-00147870-8519-4001-a7c5-02c2d107eeb3 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:23.480265 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-00147870-8519-4001-a7c5-02c2d107eeb3 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:23.481085 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-00147870-8519-4001-a7c5-02c2d107eeb3 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:23.482953 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-00147870-8519-4001-a7c5-02c2d107eeb3 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:23.483575 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-00147870-8519-4001-a7c5-02c2d107eeb3 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:23.665257 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-00147870-8519-4001-a7c5-02c2d107eeb3 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:23.674562 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-00147870-8519-4001-a7c5-02c2d107eeb3 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1515 microversion: 2.1 time: 0.206500 Jul 31 18:39:23.675378 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 146/277] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:23 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1515 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:23.703788 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-36290010-c150-45fe-8683-c4db7ae5c332 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:23.714125 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-36290010-c150-45fe-8683-c4db7ae5c332 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:23.716262 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-36290010-c150-45fe-8683-c4db7ae5c332 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:23.718250 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-36290010-c150-45fe-8683-c4db7ae5c332 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1723 microversion: 2.20 time: 0.274425 Jul 31 18:39:23.734605 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 132/278] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:23 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:24.029897 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4e1942bc-39c7-4ac9-8cb0-7e4f890e106e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:24.030912 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-4e1942bc-39c7-4ac9-8cb0-7e4f890e106e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 8ccfba99-9116-4274-a24e-1615c1a661fa] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:24.037905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4e1942bc-39c7-4ac9-8cb0-7e4f890e106e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:24.038386 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4e1942bc-39c7-4ac9-8cb0-7e4f890e106e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:24.039262 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4e1942bc-39c7-4ac9-8cb0-7e4f890e106e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:24.039695 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4e1942bc-39c7-4ac9-8cb0-7e4f890e106e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:24.193505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-4e1942bc-39c7-4ac9-8cb0-7e4f890e106e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:24.201668 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-4e1942bc-39c7-4ac9-8cb0-7e4f890e106e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa" status: 200 len: 1368 microversion: 2.1 time: 0.176034 Jul 31 18:39:24.202245 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 147/279] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:24 2022] GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:24.671947 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-7797c591-429e-454b-be21-7619892d61cd tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:24.678992 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7797c591-429e-454b-be21-7619892d61cd tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:24.679573 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7797c591-429e-454b-be21-7619892d61cd tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:24.741980 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-7797c591-429e-454b-be21-7619892d61cd tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Going to try to stop instance {{(pid=124333) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 31 18:39:24.746653 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-af20fcae-b783-4780-9fdf-e00e8c433d44 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:24.748323 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-af20fcae-b783-4780-9fdf-e00e8c433d44 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:24.755677 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-af20fcae-b783-4780-9fdf-e00e8c433d44 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:24.756201 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-af20fcae-b783-4780-9fdf-e00e8c433d44 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:24.757148 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-af20fcae-b783-4780-9fdf-e00e8c433d44 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:24.757574 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-af20fcae-b783-4780-9fdf-e00e8c433d44 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:24.795833 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-7797c591-429e-454b-be21-7619892d61cd tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "POST /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92/action" status: 202 len: 0 microversion: 2.1 time: 0.127758 Jul 31 18:39:24.796440 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 133/280] 10.222.0.49 () {60 vars in 1278 bytes} [Sun Jul 31 18:39:24 2022] POST /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:39:24.804799 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-c2eca9c5-3f3f-4ea4-83c0-a1730a7368df tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:24.805494 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-c2eca9c5-3f3f-4ea4-83c0-a1730a7368df tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:24.812028 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c2eca9c5-3f3f-4ea4-83c0-a1730a7368df tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:24.812470 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c2eca9c5-3f3f-4ea4-83c0-a1730a7368df tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:24.813249 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c2eca9c5-3f3f-4ea4-83c0-a1730a7368df tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:24.813676 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c2eca9c5-3f3f-4ea4-83c0-a1730a7368df tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:24.910475 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-af20fcae-b783-4780-9fdf-e00e8c433d44 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:24.918558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-af20fcae-b783-4780-9fdf-e00e8c433d44 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:24.920106 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-af20fcae-b783-4780-9fdf-e00e8c433d44 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:24.921286 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-af20fcae-b783-4780-9fdf-e00e8c433d44 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1723 microversion: 2.20 time: 0.181235 Jul 31 18:39:24.921844 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 148/281] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:24 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:24.927085 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-6e16ee9b-a790-4077-826d-9630104cd83b tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-339397282", "imageRef": "6f2a0bb6-2fb3-4536-bee3-23e4e975f079", "flavorRef": "452", "networks": [{"uuid": "c50e1e61-1500-4bfb-8d85-b78aab4ac006"}]}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:24.962144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-c2eca9c5-3f3f-4ea4-83c0-a1730a7368df tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:24.970466 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-c2eca9c5-3f3f-4ea4-83c0-a1730a7368df tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1724 microversion: 2.1 time: 0.169641 Jul 31 18:39:24.971035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 134/282] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:24 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:39:24.979851 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.network.neutron [None req-6e16ee9b-a790-4077-826d-9630104cd83b tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] validate_networks() for [('c50e1e61-1500-4bfb-8d85-b78aab4ac006', None, None, None, None, None)] {{(pid=124334) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 18:39:25.062697 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-35b518b7-0072-4450-bc79-889048a3d894 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Action: 'create', calling method: .version_select at 0x7f870a26ca60>, body: {"keypair": {"name": "tempest-keypair-1630620146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvHIymuUJpLOJ7ayOaiDTtc2O/oT0kk+Sdmnxoyzqoj5ggA933bQOxn+bgvTwmHMgV0GZVje0NAsJVzFbYog/JtM54bZlpjJNE0Lved7YdIQb0O/mAnTdPtb+tedDiQ0Q=="}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:25.078297 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-35b518b7-0072-4450-bc79-889048a3d894 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Getting quotas for project df42ccb208664e04ac753b0c64b4fab7. Resources: {'key_pairs'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:39:25.082330 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-35b518b7-0072-4450-bc79-889048a3d894 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Getting quotas for user 0d7ed577305d48c795f280e49b438bfc and project df42ccb208664e04ac753b0c64b4fab7. Resources: {'key_pairs'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:39:25.106302 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-35b518b7-0072-4450-bc79-889048a3d894 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047459 Jul 31 18:39:25.106911 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 135/283] 10.222.0.49 () {60 vars in 1159 bytes} [Sun Jul 31 18:39:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:39:25.229907 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-604523b5-bb75-4088-a7d7-4acef5c982ac tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:25.230782 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-604523b5-bb75-4088-a7d7-4acef5c982ac tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 8ccfba99-9116-4274-a24e-1615c1a661fa] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:25.238601 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-604523b5-bb75-4088-a7d7-4acef5c982ac tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:25.239757 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-604523b5-bb75-4088-a7d7-4acef5c982ac tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:25.240754 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-604523b5-bb75-4088-a7d7-4acef5c982ac tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:25.241419 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-604523b5-bb75-4088-a7d7-4acef5c982ac tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:25.341196 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-6e16ee9b-a790-4077-826d-9630104cd83b tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Flavor limits 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 18:39:25.342540 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-6e16ee9b-a790-4077-826d-9630104cd83b tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Image limits 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 18:39:25.343247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-6e16ee9b-a790-4077-826d-9630104cd83b tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Flavor pref 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 18:39:25.343685 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-6e16ee9b-a790-4077-826d-9630104cd83b tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Image pref 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 18:39:25.344304 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-6e16ee9b-a790-4077-826d-9630104cd83b tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 18:39:25.355409 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6e16ee9b-a790-4077-826d-9630104cd83b tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:25.355858 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6e16ee9b-a790-4077-826d-9630104cd83b tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:25.356695 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6e16ee9b-a790-4077-826d-9630104cd83b tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:25.357340 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6e16ee9b-a790-4077-826d-9630104cd83b tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:25.376663 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.quota [None req-6e16ee9b-a790-4077-826d-9630104cd83b tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Getting quotas for project 91867ca69f334c76a3671331612ea954. Resources: {'cores', 'ram', 'instances'} {{(pid=124334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:39:25.382379 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.quota [None req-6e16ee9b-a790-4077-826d-9630104cd83b tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Getting quotas for user 0e0a63102acb43158fb074f468ca2faf and project 91867ca69f334c76a3671331612ea954. Resources: {'cores', 'ram', 'instances'} {{(pid=124334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:39:25.396556 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-6e16ee9b-a790-4077-826d-9630104cd83b tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Going to run 1 instances... {{(pid=124334) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 18:39:25.399579 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-6e16ee9b-a790-4077-826d-9630104cd83b tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: c7acb0e5-b78a-4c7f-a880-6007ea7be5fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f2a0bb6-2fb3-4536-bee3-23e4e975f079',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 18:39:25.447325 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-6e16ee9b-a790-4077-826d-9630104cd83b tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524446 Jul 31 18:39:25.448226 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 149/284] 10.222.0.49 () {60 vars in 1147 bytes} [Sun Jul 31 18:39:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 18:39:25.459052 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-d4532f2b-9e0c-41b1-aabd-f76a6c58270f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:25.459709 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-d4532f2b-9e0c-41b1-aabd-f76a6c58270f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: c7acb0e5-b78a-4c7f-a880-6007ea7be5fe] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:25.521774 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-d4532f2b-9e0c-41b1-aabd-f76a6c58270f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:25.529158 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-d4532f2b-9e0c-41b1-aabd-f76a6c58270f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe" status: 200 len: 1213 microversion: 2.1 time: 0.073738 Jul 31 18:39:25.529716 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 150/285] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:25 2022] GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:39:25.595737 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-604523b5-bb75-4088-a7d7-4acef5c982ac tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:25.619596 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-604523b5-bb75-4088-a7d7-4acef5c982ac tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa" status: 200 len: 1368 microversion: 2.1 time: 0.401173 Jul 31 18:39:25.620347 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 136/286] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:25 2022] GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa => generated 1368 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:39:25.944689 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-b9a531b2-754b-4724-a290-8f25e5838ffd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:25.945320 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-b9a531b2-754b-4724-a290-8f25e5838ffd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:25.951718 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b9a531b2-754b-4724-a290-8f25e5838ffd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:25.952202 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b9a531b2-754b-4724-a290-8f25e5838ffd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:25.953868 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b9a531b2-754b-4724-a290-8f25e5838ffd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:25.954340 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b9a531b2-754b-4724-a290-8f25e5838ffd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:25.999434 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-080c18c2-6de4-435d-a02b-8b25e6d3c379 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:26.000790 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-080c18c2-6de4-435d-a02b-8b25e6d3c379 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:26.013843 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-080c18c2-6de4-435d-a02b-8b25e6d3c379 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:26.021546 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-080c18c2-6de4-435d-a02b-8b25e6d3c379 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:26.022379 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-080c18c2-6de4-435d-a02b-8b25e6d3c379 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:26.022811 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-080c18c2-6de4-435d-a02b-8b25e6d3c379 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:26.239403 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-080c18c2-6de4-435d-a02b-8b25e6d3c379 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:26.248399 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-080c18c2-6de4-435d-a02b-8b25e6d3c379 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1724 microversion: 2.1 time: 0.260539 Jul 31 18:39:26.249411 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 137/287] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:25 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:39:26.326145 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-b9a531b2-754b-4724-a290-8f25e5838ffd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:26.334295 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-b9a531b2-754b-4724-a290-8f25e5838ffd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:26.335766 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-b9a531b2-754b-4724-a290-8f25e5838ffd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:26.336937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-b9a531b2-754b-4724-a290-8f25e5838ffd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1723 microversion: 2.20 time: 0.396297 Jul 31 18:39:26.337493 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 151/288] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:25 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1723 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:26.550604 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-eb3c1da3-98ec-410a-9991-318a72e23ea8 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:26.551418 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-eb3c1da3-98ec-410a-9991-318a72e23ea8 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: c7acb0e5-b78a-4c7f-a880-6007ea7be5fe] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:26.558893 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-eb3c1da3-98ec-410a-9991-318a72e23ea8 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:26.559564 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-eb3c1da3-98ec-410a-9991-318a72e23ea8 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:26.561052 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-eb3c1da3-98ec-410a-9991-318a72e23ea8 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:26.561659 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-eb3c1da3-98ec-410a-9991-318a72e23ea8 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:26.623008 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-fefa5bac-2199-4bfc-974e-e6c5b22ed6ba tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1845086675", "imageRef": "6f2a0bb6-2fb3-4536-bee3-23e4e975f079", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff0682ec-31f5-4445-9595-fd7388d7f61d"}], "security_groups": [{"name": "tempest-securitygroup--1052762159"}], "key_name": "tempest-keypair-1630620146", "user_data": "}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:26.649933 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-eb3c1da3-98ec-410a-9991-318a72e23ea8 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:26.661393 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-eb3c1da3-98ec-410a-9991-318a72e23ea8 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe" status: 200 len: 1273 microversion: 2.1 time: 0.113714 Jul 31 18:39:26.664268 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 138/289] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:26 2022] GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe => generated 1273 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:26.681876 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-bd9da82b-85a1-48cd-a376-6aed9383e39e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:26.682516 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-bd9da82b-85a1-48cd-a376-6aed9383e39e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 8ccfba99-9116-4274-a24e-1615c1a661fa] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:26.691439 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bd9da82b-85a1-48cd-a376-6aed9383e39e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:26.691871 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bd9da82b-85a1-48cd-a376-6aed9383e39e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:26.694250 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bd9da82b-85a1-48cd-a376-6aed9383e39e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:26.694721 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bd9da82b-85a1-48cd-a376-6aed9383e39e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:26.749386 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.network.neutron [None req-fefa5bac-2199-4bfc-974e-e6c5b22ed6ba tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] validate_networks() for [('ff0682ec-31f5-4445-9595-fd7388d7f61d', None, None, None, None, None)] {{(pid=124334) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 18:39:26.888403 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-bd9da82b-85a1-48cd-a376-6aed9383e39e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:26.896026 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-bd9da82b-85a1-48cd-a376-6aed9383e39e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa" status: 200 len: 1368 microversion: 2.1 time: 0.230055 Jul 31 18:39:26.896585 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 139/290] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:26 2022] GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:27.134401 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-fefa5bac-2199-4bfc-974e-e6c5b22ed6ba tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Flavor limits 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 18:39:27.135054 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-fefa5bac-2199-4bfc-974e-e6c5b22ed6ba tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Image limits 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 18:39:27.135961 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-fefa5bac-2199-4bfc-974e-e6c5b22ed6ba tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Flavor pref 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 18:39:27.136364 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-fefa5bac-2199-4bfc-974e-e6c5b22ed6ba tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Image pref 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 18:39:27.136876 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-fefa5bac-2199-4bfc-974e-e6c5b22ed6ba tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 18:39:27.147128 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fefa5bac-2199-4bfc-974e-e6c5b22ed6ba tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:27.147672 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fefa5bac-2199-4bfc-974e-e6c5b22ed6ba tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:27.148579 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fefa5bac-2199-4bfc-974e-e6c5b22ed6ba tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:27.149436 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fefa5bac-2199-4bfc-974e-e6c5b22ed6ba tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:27.166640 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.quota [None req-fefa5bac-2199-4bfc-974e-e6c5b22ed6ba tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Getting quotas for project df42ccb208664e04ac753b0c64b4fab7. Resources: {'cores', 'ram', 'instances'} {{(pid=124334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:39:27.170660 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.quota [None req-fefa5bac-2199-4bfc-974e-e6c5b22ed6ba tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Getting quotas for user 0d7ed577305d48c795f280e49b438bfc and project df42ccb208664e04ac753b0c64b4fab7. Resources: {'cores', 'ram', 'instances'} {{(pid=124334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:39:27.182604 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-fefa5bac-2199-4bfc-974e-e6c5b22ed6ba tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Going to run 1 instances... {{(pid=124334) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 18:39:27.184810 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-fefa5bac-2199-4bfc-974e-e6c5b22ed6ba tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f2a0bb6-2fb3-4536-bee3-23e4e975f079',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 18:39:27.231870 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-fefa5bac-2199-4bfc-974e-e6c5b22ed6ba tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.613049 Jul 31 18:39:27.232561 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 152/291] 10.222.0.49 () {60 vars in 1147 bytes} [Sun Jul 31 18:39:26 2022] POST /compute/v2.1/servers => generated 409 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 18:39:27.243384 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-80ba07bf-3585-4db5-b3c6-dc9fdafa67e1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:27.243992 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-80ba07bf-3585-4db5-b3c6-dc9fdafa67e1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:27.271642 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-a770a34d-3ba5-48b5-9eba-feb397133316 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:27.272321 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-a770a34d-3ba5-48b5-9eba-feb397133316 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:27.278653 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a770a34d-3ba5-48b5-9eba-feb397133316 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:27.279281 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a770a34d-3ba5-48b5-9eba-feb397133316 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:27.280058 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a770a34d-3ba5-48b5-9eba-feb397133316 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:27.282525 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a770a34d-3ba5-48b5-9eba-feb397133316 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:27.308572 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-80ba07bf-3585-4db5-b3c6-dc9fdafa67e1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:27.317001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-80ba07bf-3585-4db5-b3c6-dc9fdafa67e1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1246 microversion: 2.1 time: 0.077328 Jul 31 18:39:27.330282 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 140/292] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:27 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:27.359954 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-70edffea-c43e-4dbf-8992-544c00075c2f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:27.360563 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-70edffea-c43e-4dbf-8992-544c00075c2f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:27.374564 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-70edffea-c43e-4dbf-8992-544c00075c2f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:27.375016 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-70edffea-c43e-4dbf-8992-544c00075c2f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:27.376992 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-70edffea-c43e-4dbf-8992-544c00075c2f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:27.377439 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-70edffea-c43e-4dbf-8992-544c00075c2f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:27.454134 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-a770a34d-3ba5-48b5-9eba-feb397133316 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:27.463550 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-a770a34d-3ba5-48b5-9eba-feb397133316 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1724 microversion: 2.1 time: 0.196486 Jul 31 18:39:27.477741 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 153/293] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:27 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:27.690711 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-5ad35163-c42b-4a43-b99f-cfeb5c94b954 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:27.691399 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-5ad35163-c42b-4a43-b99f-cfeb5c94b954 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: c7acb0e5-b78a-4c7f-a880-6007ea7be5fe] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:27.699300 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5ad35163-c42b-4a43-b99f-cfeb5c94b954 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:27.700441 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5ad35163-c42b-4a43-b99f-cfeb5c94b954 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:27.700801 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5ad35163-c42b-4a43-b99f-cfeb5c94b954 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:27.701441 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5ad35163-c42b-4a43-b99f-cfeb5c94b954 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:27.798050 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-70edffea-c43e-4dbf-8992-544c00075c2f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:27.808374 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-70edffea-c43e-4dbf-8992-544c00075c2f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:27.810649 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-70edffea-c43e-4dbf-8992-544c00075c2f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:27.813107 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-70edffea-c43e-4dbf-8992-544c00075c2f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1723 microversion: 2.20 time: 0.457254 Jul 31 18:39:27.814592 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 141/294] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:27 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1723 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:27.881852 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-5ad35163-c42b-4a43-b99f-cfeb5c94b954 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:27.890211 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-5ad35163-c42b-4a43-b99f-cfeb5c94b954 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe" status: 200 len: 1313 microversion: 2.1 time: 0.207747 Jul 31 18:39:27.891227 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 154/295] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:27 2022] GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:39:27.917139 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-2f7df15f-6043-4f0b-a8bd-31522d377f15 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:27.917884 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-2f7df15f-6043-4f0b-a8bd-31522d377f15 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 8ccfba99-9116-4274-a24e-1615c1a661fa] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:27.924384 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2f7df15f-6043-4f0b-a8bd-31522d377f15 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:27.925012 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2f7df15f-6043-4f0b-a8bd-31522d377f15 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:27.926050 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2f7df15f-6043-4f0b-a8bd-31522d377f15 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:27.926558 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2f7df15f-6043-4f0b-a8bd-31522d377f15 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:28.154151 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-2f7df15f-6043-4f0b-a8bd-31522d377f15 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:28.161994 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-2f7df15f-6043-4f0b-a8bd-31522d377f15 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa" status: 200 len: 1368 microversion: 2.1 time: 0.248919 Jul 31 18:39:28.162570 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 142/296] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:27 2022] GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa => generated 1368 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:28.338437 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-874bcce3-dade-4078-ab0e-b04fcfcd75a8 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:28.339142 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-874bcce3-dade-4078-ab0e-b04fcfcd75a8 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:28.347756 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-874bcce3-dade-4078-ab0e-b04fcfcd75a8 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:28.348333 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-874bcce3-dade-4078-ab0e-b04fcfcd75a8 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:28.349225 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-874bcce3-dade-4078-ab0e-b04fcfcd75a8 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:28.349886 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-874bcce3-dade-4078-ab0e-b04fcfcd75a8 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:28.419119 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-874bcce3-dade-4078-ab0e-b04fcfcd75a8 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:28.427390 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-874bcce3-dade-4078-ab0e-b04fcfcd75a8 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1306 microversion: 2.1 time: 0.093257 Jul 31 18:39:28.427955 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 155/297] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:28 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1306 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:28.486699 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-c6a16e80-c959-42a9-b408-b4a57d778b05 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:28.487300 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-c6a16e80-c959-42a9-b408-b4a57d778b05 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:28.493986 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c6a16e80-c959-42a9-b408-b4a57d778b05 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:28.494446 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c6a16e80-c959-42a9-b408-b4a57d778b05 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:28.495307 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c6a16e80-c959-42a9-b408-b4a57d778b05 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:28.495825 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c6a16e80-c959-42a9-b408-b4a57d778b05 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:28.665327 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-c5cc9f16-45b6-40f6-a7af-6d310a5ef752 req-37e49d04-4256-4b48-8e59-87113e6d772b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7acb0e5-b78a-4c7f-a880-6007ea7be5fe", "tag": "2b22a4bd-e29d-408a-8f48-9420a2fb07da"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:28.676908 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-c5cc9f16-45b6-40f6-a7af-6d310a5ef752 req-37e49d04-4256-4b48-8e59-87113e6d772b service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:28.677353 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-c5cc9f16-45b6-40f6-a7af-6d310a5ef752 req-37e49d04-4256-4b48-8e59-87113e6d772b service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:28.691540 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-c5cc9f16-45b6-40f6-a7af-6d310a5ef752 req-37e49d04-4256-4b48-8e59-87113e6d772b service nova] Creating event network-changed:2b22a4bd-e29d-408a-8f48-9420a2fb07da for instance c7acb0e5-b78a-4c7f-a880-6007ea7be5fe on hv-cinder-84984 Jul 31 18:39:28.698264 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-c5cc9f16-45b6-40f6-a7af-6d310a5ef752 req-37e49d04-4256-4b48-8e59-87113e6d772b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037452 Jul 31 18:39:28.698907 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 156/298] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:39:28.839018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-512e38a2-10dd-4b65-8323-660a952094a6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:28.840156 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-c6a16e80-c959-42a9-b408-b4a57d778b05 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:28.840720 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-512e38a2-10dd-4b65-8323-660a952094a6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:28.847858 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-512e38a2-10dd-4b65-8323-660a952094a6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:28.848573 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-512e38a2-10dd-4b65-8323-660a952094a6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:28.848732 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-c6a16e80-c959-42a9-b408-b4a57d778b05 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1724 microversion: 2.1 time: 0.365891 Jul 31 18:39:28.858555 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-512e38a2-10dd-4b65-8323-660a952094a6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:28.858753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 143/299] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:28 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1724 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:39:28.858868 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-512e38a2-10dd-4b65-8323-660a952094a6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:28.913833 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-527d75c8-3b3a-4788-bbe5-e126b091ec0f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:28.915096 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-527d75c8-3b3a-4788-bbe5-e126b091ec0f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: c7acb0e5-b78a-4c7f-a880-6007ea7be5fe] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:28.922034 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-527d75c8-3b3a-4788-bbe5-e126b091ec0f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:28.922500 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-527d75c8-3b3a-4788-bbe5-e126b091ec0f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:28.923413 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-527d75c8-3b3a-4788-bbe5-e126b091ec0f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:28.923847 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-527d75c8-3b3a-4788-bbe5-e126b091ec0f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:28.985616 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-512e38a2-10dd-4b65-8323-660a952094a6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:28.994821 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-512e38a2-10dd-4b65-8323-660a952094a6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:28.996697 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-512e38a2-10dd-4b65-8323-660a952094a6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:28.998324 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-512e38a2-10dd-4b65-8323-660a952094a6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1744 microversion: 2.20 time: 0.164873 Jul 31 18:39:28.998879 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 157/300] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:28 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:29.183816 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-66a6258e-6327-413d-89c5-a4f25686ae7d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:29.184394 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-66a6258e-6327-413d-89c5-a4f25686ae7d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 8ccfba99-9116-4274-a24e-1615c1a661fa] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:29.191943 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-66a6258e-6327-413d-89c5-a4f25686ae7d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:29.192451 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-66a6258e-6327-413d-89c5-a4f25686ae7d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:29.193266 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-66a6258e-6327-413d-89c5-a4f25686ae7d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:29.193701 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-66a6258e-6327-413d-89c5-a4f25686ae7d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:29.208232 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell0:SELECT=2 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:29.242842 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-527d75c8-3b3a-4788-bbe5-e126b091ec0f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:29.251240 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-527d75c8-3b3a-4788-bbe5-e126b091ec0f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe" status: 200 len: 1313 microversion: 2.1 time: 0.343443 Jul 31 18:39:29.251910 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 144/301] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:28 2022] GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:29.333287 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-66a6258e-6327-413d-89c5-a4f25686ae7d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:29.340993 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-66a6258e-6327-413d-89c5-a4f25686ae7d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa" status: 200 len: 1368 microversion: 2.1 time: 0.161209 Jul 31 18:39:29.341666 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 158/302] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:29 2022] GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:29.451562 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-39bf8705-7af8-4e00-8d44-c22868bc8d6d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:29.452575 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-39bf8705-7af8-4e00-8d44-c22868bc8d6d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:29.460854 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-39bf8705-7af8-4e00-8d44-c22868bc8d6d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:29.462239 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-39bf8705-7af8-4e00-8d44-c22868bc8d6d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:29.463308 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-39bf8705-7af8-4e00-8d44-c22868bc8d6d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:29.463868 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-39bf8705-7af8-4e00-8d44-c22868bc8d6d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:29.539785 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-39bf8705-7af8-4e00-8d44-c22868bc8d6d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:29.548375 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-39bf8705-7af8-4e00-8d44-c22868bc8d6d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1304 microversion: 2.1 time: 0.102551 Jul 31 18:39:29.549169 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 145/303] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:29 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:29.687673 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-e362c7f3-d95e-4077-9d62-09d9b81a09ab req-938c11bf-c1df-460a-ba0f-7dab867e3703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ccfba99-9116-4274-a24e-1615c1a661fa", "name": "network-vif-plugged", "status": "completed", "tag": "2900adf5-d18f-4ff5-81c3-7e992ab7af76"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:29.703293 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-e362c7f3-d95e-4077-9d62-09d9b81a09ab req-938c11bf-c1df-460a-ba0f-7dab867e3703 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:29.703924 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-e362c7f3-d95e-4077-9d62-09d9b81a09ab req-938c11bf-c1df-460a-ba0f-7dab867e3703 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:29.718114 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-e362c7f3-d95e-4077-9d62-09d9b81a09ab req-938c11bf-c1df-460a-ba0f-7dab867e3703 service nova] Creating event network-vif-plugged:2900adf5-d18f-4ff5-81c3-7e992ab7af76 for instance 8ccfba99-9116-4274-a24e-1615c1a661fa on hv-cinder-84984 Jul 31 18:39:29.724373 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-e362c7f3-d95e-4077-9d62-09d9b81a09ab req-938c11bf-c1df-460a-ba0f-7dab867e3703 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042228 Jul 31 18:39:29.726334 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 159/304] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:39:29.870216 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-4bc752eb-28a7-493b-8e08-de5010711a9a tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:29.870816 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-4bc752eb-28a7-493b-8e08-de5010711a9a tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:29.877169 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4bc752eb-28a7-493b-8e08-de5010711a9a tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:29.877615 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4bc752eb-28a7-493b-8e08-de5010711a9a tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:29.878738 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4bc752eb-28a7-493b-8e08-de5010711a9a tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:29.879179 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4bc752eb-28a7-493b-8e08-de5010711a9a tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:30.010413 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-4bc752eb-28a7-493b-8e08-de5010711a9a tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:30.018601 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-4bc752eb-28a7-493b-8e08-de5010711a9a tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1724 microversion: 2.1 time: 0.152340 Jul 31 18:39:30.019177 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 146/305] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:29 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:30.022673 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-3e1ed76d-cd33-4c9f-9f59-d6f65f82bf36 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:30.023368 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-3e1ed76d-cd33-4c9f-9f59-d6f65f82bf36 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:30.029896 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3e1ed76d-cd33-4c9f-9f59-d6f65f82bf36 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:30.030348 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3e1ed76d-cd33-4c9f-9f59-d6f65f82bf36 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:30.031112 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3e1ed76d-cd33-4c9f-9f59-d6f65f82bf36 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:30.031551 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3e1ed76d-cd33-4c9f-9f59-d6f65f82bf36 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:30.185403 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-3e1ed76d-cd33-4c9f-9f59-d6f65f82bf36 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:30.196181 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-3e1ed76d-cd33-4c9f-9f59-d6f65f82bf36 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:30.198500 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-3e1ed76d-cd33-4c9f-9f59-d6f65f82bf36 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:30.200212 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-3e1ed76d-cd33-4c9f-9f59-d6f65f82bf36 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1744 microversion: 2.20 time: 0.181648 Jul 31 18:39:30.200981 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 160/306] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:30 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1744 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:30.276362 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-965f09b0-2e99-46e0-ae77-7d7d265f9c3d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:30.277426 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-965f09b0-2e99-46e0-ae77-7d7d265f9c3d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: c7acb0e5-b78a-4c7f-a880-6007ea7be5fe] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:30.280305 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:30.289557 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-965f09b0-2e99-46e0-ae77-7d7d265f9c3d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:30.290309 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-965f09b0-2e99-46e0-ae77-7d7d265f9c3d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:30.291557 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-965f09b0-2e99-46e0-ae77-7d7d265f9c3d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:30.292302 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-965f09b0-2e99-46e0-ae77-7d7d265f9c3d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:30.362012 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-2b787b41-c8ef-4d0b-a711-665bd7b50faa tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:30.362619 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-2b787b41-c8ef-4d0b-a711-665bd7b50faa tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 8ccfba99-9116-4274-a24e-1615c1a661fa] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:30.369324 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2b787b41-c8ef-4d0b-a711-665bd7b50faa tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:30.369769 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2b787b41-c8ef-4d0b-a711-665bd7b50faa tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:30.370531 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2b787b41-c8ef-4d0b-a711-665bd7b50faa tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:30.370959 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2b787b41-c8ef-4d0b-a711-665bd7b50faa tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:30.430854 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-965f09b0-2e99-46e0-ae77-7d7d265f9c3d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:30.438471 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-965f09b0-2e99-46e0-ae77-7d7d265f9c3d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe" status: 200 len: 1313 microversion: 2.1 time: 0.168582 Jul 31 18:39:30.439067 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 147/307] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:30 2022] GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:30.503747 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-2b787b41-c8ef-4d0b-a711-665bd7b50faa tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:30.514708 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-2b787b41-c8ef-4d0b-a711-665bd7b50faa tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa" status: 200 len: 1368 microversion: 2.1 time: 0.156588 Jul 31 18:39:30.515278 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 161/308] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:30 2022] GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:39:30.571580 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-e6cdfbdb-21ff-43f5-8831-bf05831aaa95 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:30.572167 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-e6cdfbdb-21ff-43f5-8831-bf05831aaa95 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:30.579346 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e6cdfbdb-21ff-43f5-8831-bf05831aaa95 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:30.579774 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e6cdfbdb-21ff-43f5-8831-bf05831aaa95 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:30.580538 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e6cdfbdb-21ff-43f5-8831-bf05831aaa95 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:30.580996 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e6cdfbdb-21ff-43f5-8831-bf05831aaa95 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:31.040333 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-c74f2295-e1fc-496f-a84d-2cefe92718db tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:31.040938 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-c74f2295-e1fc-496f-a84d-2cefe92718db tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:31.048194 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c74f2295-e1fc-496f-a84d-2cefe92718db tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:31.048638 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c74f2295-e1fc-496f-a84d-2cefe92718db tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:31.049428 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c74f2295-e1fc-496f-a84d-2cefe92718db tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:31.049875 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c74f2295-e1fc-496f-a84d-2cefe92718db tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:31.187818 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-c74f2295-e1fc-496f-a84d-2cefe92718db tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:31.191305 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-e6cdfbdb-21ff-43f5-8831-bf05831aaa95 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:31.200146 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-c74f2295-e1fc-496f-a84d-2cefe92718db tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1724 microversion: 2.1 time: 0.163795 Jul 31 18:39:31.200736 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 162/309] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:31 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:39:31.201831 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-e6cdfbdb-21ff-43f5-8831-bf05831aaa95 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1372 microversion: 2.1 time: 0.636003 Jul 31 18:39:31.215223 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 148/310] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:30 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1372 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:31.223663 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-c89f139f-4e8b-43c3-82c9-5ccb1afb8d9a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:31.224741 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-c89f139f-4e8b-43c3-82c9-5ccb1afb8d9a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:31.231593 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c89f139f-4e8b-43c3-82c9-5ccb1afb8d9a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:31.232238 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c89f139f-4e8b-43c3-82c9-5ccb1afb8d9a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:31.233034 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c89f139f-4e8b-43c3-82c9-5ccb1afb8d9a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:31.233464 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c89f139f-4e8b-43c3-82c9-5ccb1afb8d9a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:31.369026 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-c89f139f-4e8b-43c3-82c9-5ccb1afb8d9a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:31.377882 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-c89f139f-4e8b-43c3-82c9-5ccb1afb8d9a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:31.380424 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-c89f139f-4e8b-43c3-82c9-5ccb1afb8d9a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:31.381952 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-c89f139f-4e8b-43c3-82c9-5ccb1afb8d9a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1739 microversion: 2.20 time: 0.163042 Jul 31 18:39:31.382583 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 163/311] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:31 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:31.459669 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-75fc56fc-0d75-4d6b-92b1-bc02263babb9 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:31.460602 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-75fc56fc-0d75-4d6b-92b1-bc02263babb9 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: c7acb0e5-b78a-4c7f-a880-6007ea7be5fe] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:31.467078 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-75fc56fc-0d75-4d6b-92b1-bc02263babb9 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:31.467683 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-75fc56fc-0d75-4d6b-92b1-bc02263babb9 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:31.468590 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-75fc56fc-0d75-4d6b-92b1-bc02263babb9 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:31.469187 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-75fc56fc-0d75-4d6b-92b1-bc02263babb9 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:31.486149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:31.539186 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-dee2b275-5dc1-48be-95a5-04faa1764411 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:31.540026 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-dee2b275-5dc1-48be-95a5-04faa1764411 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 8ccfba99-9116-4274-a24e-1615c1a661fa] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:31.556194 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-dee2b275-5dc1-48be-95a5-04faa1764411 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:31.557855 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-dee2b275-5dc1-48be-95a5-04faa1764411 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:31.559596 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-dee2b275-5dc1-48be-95a5-04faa1764411 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:31.560437 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-dee2b275-5dc1-48be-95a5-04faa1764411 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:31.711896 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-dee2b275-5dc1-48be-95a5-04faa1764411 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:31.719418 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-dee2b275-5dc1-48be-95a5-04faa1764411 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa" status: 200 len: 1368 microversion: 2.1 time: 0.185109 Jul 31 18:39:31.719984 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 164/312] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:31 2022] GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:31.735288 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-75fc56fc-0d75-4d6b-92b1-bc02263babb9 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:31.740343 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-f80bdc2f-336c-4d3d-ab82-f090e5000158 req-0f76be12-1eb9-431c-9c81-491b7057c8c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "432e6c6a-9a11-4f18-8dbe-fbb82e95f39f", "name": "network-vif-plugged", "status": "completed", "tag": "2a079287-92d9-4c25-bdec-babc0efb1738"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:31.743529 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-75fc56fc-0d75-4d6b-92b1-bc02263babb9 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe" status: 200 len: 1313 microversion: 2.1 time: 0.287895 Jul 31 18:39:31.744077 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 149/313] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:31 2022] GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:31.750334 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-f80bdc2f-336c-4d3d-ab82-f090e5000158 req-0f76be12-1eb9-431c-9c81-491b7057c8c3 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:31.750986 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-f80bdc2f-336c-4d3d-ab82-f090e5000158 req-0f76be12-1eb9-431c-9c81-491b7057c8c3 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:31.762416 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-f80bdc2f-336c-4d3d-ab82-f090e5000158 req-0f76be12-1eb9-431c-9c81-491b7057c8c3 service nova] Creating event network-vif-plugged:2a079287-92d9-4c25-bdec-babc0efb1738 for instance 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f on hv-cinder-84984 Jul 31 18:39:31.767327 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-f80bdc2f-336c-4d3d-ab82-f090e5000158 req-0f76be12-1eb9-431c-9c81-491b7057c8c3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030631 Jul 31 18:39:31.767952 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 165/314] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:39:31.824834 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-9dea94e0-216d-4e04-bb92-3681e52e86e4 req-32834912-5cee-422a-8e80-36d7739b070d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4377ead1-89c3-4e21-b45c-c20dcf7bacf9", "tag": "4200cac4-2be0-4499-a408-eff0761571a8"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:31.835391 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-9dea94e0-216d-4e04-bb92-3681e52e86e4 req-32834912-5cee-422a-8e80-36d7739b070d service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:31.835828 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-9dea94e0-216d-4e04-bb92-3681e52e86e4 req-32834912-5cee-422a-8e80-36d7739b070d service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:31.847530 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-9dea94e0-216d-4e04-bb92-3681e52e86e4 req-32834912-5cee-422a-8e80-36d7739b070d service nova] Creating event network-changed:4200cac4-2be0-4499-a408-eff0761571a8 for instance 4377ead1-89c3-4e21-b45c-c20dcf7bacf9 on hv-cinder-84984 Jul 31 18:39:31.853341 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-9dea94e0-216d-4e04-bb92-3681e52e86e4 req-32834912-5cee-422a-8e80-36d7739b070d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033166 Jul 31 18:39:31.854253 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 150/315] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:39:32.224118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-08a2f5f3-2bea-46b6-aa8f-fd8473d8d0ae tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:32.230997 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-8b04f4d2-a330-47e0-b31b-05edc99abbdf tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:32.231881 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-8b04f4d2-a330-47e0-b31b-05edc99abbdf tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:32.233481 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-08a2f5f3-2bea-46b6-aa8f-fd8473d8d0ae tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:32.245638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8b04f4d2-a330-47e0-b31b-05edc99abbdf tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:32.246069 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8b04f4d2-a330-47e0-b31b-05edc99abbdf tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:32.246884 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8b04f4d2-a330-47e0-b31b-05edc99abbdf tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:32.248902 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-08a2f5f3-2bea-46b6-aa8f-fd8473d8d0ae tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:32.249341 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-08a2f5f3-2bea-46b6-aa8f-fd8473d8d0ae tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:32.250680 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-08a2f5f3-2bea-46b6-aa8f-fd8473d8d0ae tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:32.250680 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-08a2f5f3-2bea-46b6-aa8f-fd8473d8d0ae tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:32.255634 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8b04f4d2-a330-47e0-b31b-05edc99abbdf tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:32.278213 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=100 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:32.423312 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-08a2f5f3-2bea-46b6-aa8f-fd8473d8d0ae tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:32.430897 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-08a2f5f3-2bea-46b6-aa8f-fd8473d8d0ae tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1372 microversion: 2.1 time: 0.211405 Jul 31 18:39:32.432533 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 166/316] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:32 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1372 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:32.437325 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-527d00c0-42e8-4b18-8531-04e856c85ae1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:32.437922 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-527d00c0-42e8-4b18-8531-04e856c85ae1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:32.443793 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-527d00c0-42e8-4b18-8531-04e856c85ae1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:32.444239 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-527d00c0-42e8-4b18-8531-04e856c85ae1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:32.445024 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-527d00c0-42e8-4b18-8531-04e856c85ae1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:32.445746 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-527d00c0-42e8-4b18-8531-04e856c85ae1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:32.524876 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-8b04f4d2-a330-47e0-b31b-05edc99abbdf tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:32.553564 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-8b04f4d2-a330-47e0-b31b-05edc99abbdf tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1724 microversion: 2.1 time: 0.318780 Jul 31 18:39:32.554894 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 151/317] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:32 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1724 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:32.659145 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-527d00c0-42e8-4b18-8531-04e856c85ae1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:32.667556 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-527d00c0-42e8-4b18-8531-04e856c85ae1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:32.669347 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-527d00c0-42e8-4b18-8531-04e856c85ae1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:32.670693 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-527d00c0-42e8-4b18-8531-04e856c85ae1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1739 microversion: 2.20 time: 0.237026 Jul 31 18:39:32.671255 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 167/318] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:32 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1739 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:32.741513 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-8e9c6cdd-9d71-4448-abff-0f2ea2fb2415 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:32.742136 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-8e9c6cdd-9d71-4448-abff-0f2ea2fb2415 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 8ccfba99-9116-4274-a24e-1615c1a661fa] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:32.748337 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8e9c6cdd-9d71-4448-abff-0f2ea2fb2415 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:32.748809 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8e9c6cdd-9d71-4448-abff-0f2ea2fb2415 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:32.749574 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8e9c6cdd-9d71-4448-abff-0f2ea2fb2415 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:32.750002 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8e9c6cdd-9d71-4448-abff-0f2ea2fb2415 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:32.764742 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-520245c5-fa4d-426f-9af0-43bfd4424e7f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:32.765676 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-520245c5-fa4d-426f-9af0-43bfd4424e7f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: c7acb0e5-b78a-4c7f-a880-6007ea7be5fe] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:32.778297 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-520245c5-fa4d-426f-9af0-43bfd4424e7f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:32.778765 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-520245c5-fa4d-426f-9af0-43bfd4424e7f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:32.779597 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-520245c5-fa4d-426f-9af0-43bfd4424e7f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:32.780035 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-520245c5-fa4d-426f-9af0-43bfd4424e7f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:32.904541 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-8e9c6cdd-9d71-4448-abff-0f2ea2fb2415 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:32.913211 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-8e9c6cdd-9d71-4448-abff-0f2ea2fb2415 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa" status: 200 len: 1558 microversion: 2.1 time: 0.176072 Jul 31 18:39:32.928979 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 152/319] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:32 2022] GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa => generated 1558 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:32.934291 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-35913d73-ef4c-425e-b5e2-986336ab4d1c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:32.934781 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-35913d73-ef4c-425e-b5e2-986336ab4d1c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 8ccfba99-9116-4274-a24e-1615c1a661fa] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:32.941388 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-35913d73-ef4c-425e-b5e2-986336ab4d1c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:32.942065 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-35913d73-ef4c-425e-b5e2-986336ab4d1c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:32.942996 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-35913d73-ef4c-425e-b5e2-986336ab4d1c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:32.943577 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-35913d73-ef4c-425e-b5e2-986336ab4d1c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:32.965924 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-520245c5-fa4d-426f-9af0-43bfd4424e7f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:32.974006 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-520245c5-fa4d-426f-9af0-43bfd4424e7f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe" status: 200 len: 1313 microversion: 2.1 time: 0.213403 Jul 31 18:39:32.986971 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 168/320] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:32 2022] GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:33.037905 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-35913d73-ef4c-425e-b5e2-986336ab4d1c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107475 Jul 31 18:39:33.038498 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 153/321] 10.222.0.49 () {58 vars in 1275 bytes} [Sun Jul 31 18:39:32 2022] GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:39:33.451968 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-398d9dbc-512c-489b-b202-70ca770eab15 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:33.453219 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-398d9dbc-512c-489b-b202-70ca770eab15 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:33.455754 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:33.467950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-398d9dbc-512c-489b-b202-70ca770eab15 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:33.468623 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-398d9dbc-512c-489b-b202-70ca770eab15 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:33.471062 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-398d9dbc-512c-489b-b202-70ca770eab15 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:33.474215 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-398d9dbc-512c-489b-b202-70ca770eab15 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:33.579592 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-2fcbde95-8840-4c87-96a7-06154368dc95 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:33.580194 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-2fcbde95-8840-4c87-96a7-06154368dc95 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:33.592929 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2fcbde95-8840-4c87-96a7-06154368dc95 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:33.593382 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2fcbde95-8840-4c87-96a7-06154368dc95 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:33.594162 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2fcbde95-8840-4c87-96a7-06154368dc95 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:33.594766 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2fcbde95-8840-4c87-96a7-06154368dc95 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:33.835296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-2fcbde95-8840-4c87-96a7-06154368dc95 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:33.845664 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-2fcbde95-8840-4c87-96a7-06154368dc95 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1724 microversion: 2.1 time: 0.269986 Jul 31 18:39:33.847846 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 154/322] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:33 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:39:33.856706 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-c2378d13-a5ad-4cda-bdb1-f4577c1b3d89 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:33.857543 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-c2378d13-a5ad-4cda-bdb1-f4577c1b3d89 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:33.864801 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c2378d13-a5ad-4cda-bdb1-f4577c1b3d89 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:33.865341 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c2378d13-a5ad-4cda-bdb1-f4577c1b3d89 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:33.866179 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c2378d13-a5ad-4cda-bdb1-f4577c1b3d89 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:33.866807 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c2378d13-a5ad-4cda-bdb1-f4577c1b3d89 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:33.876280 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-398d9dbc-512c-489b-b202-70ca770eab15 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:33.884690 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-398d9dbc-512c-489b-b202-70ca770eab15 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1372 microversion: 2.1 time: 0.436748 Jul 31 18:39:33.889252 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 169/323] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:33 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1372 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:33.997340 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-58b86b88-aab6-4e7b-acaa-f5bd8978a7a3 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:33.998354 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-58b86b88-aab6-4e7b-acaa-f5bd8978a7a3 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: c7acb0e5-b78a-4c7f-a880-6007ea7be5fe] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:34.010694 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-58b86b88-aab6-4e7b-acaa-f5bd8978a7a3 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:34.012047 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-58b86b88-aab6-4e7b-acaa-f5bd8978a7a3 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:34.014206 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-58b86b88-aab6-4e7b-acaa-f5bd8978a7a3 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:34.015908 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-58b86b88-aab6-4e7b-acaa-f5bd8978a7a3 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:34.080457 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-c2378d13-a5ad-4cda-bdb1-f4577c1b3d89 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:34.097458 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-c2378d13-a5ad-4cda-bdb1-f4577c1b3d89 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:34.099383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-c2378d13-a5ad-4cda-bdb1-f4577c1b3d89 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:34.102438 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-c2378d13-a5ad-4cda-bdb1-f4577c1b3d89 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1739 microversion: 2.20 time: 0.252105 Jul 31 18:39:34.103386 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 155/324] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:33 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:34.270695 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-58b86b88-aab6-4e7b-acaa-f5bd8978a7a3 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:34.278177 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-58b86b88-aab6-4e7b-acaa-f5bd8978a7a3 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe" status: 200 len: 1313 microversion: 2.1 time: 0.286754 Jul 31 18:39:34.292165 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 170/325] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:33 2022] GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:34.625624 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-7d8fbc4e-73f1-4f72-ac33-5c94362344de req-26a51582-2a12-49f7-859e-b95f595c8d46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ccfba99-9116-4274-a24e-1615c1a661fa", "tag": "2900adf5-d18f-4ff5-81c3-7e992ab7af76"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:34.637413 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-7d8fbc4e-73f1-4f72-ac33-5c94362344de req-26a51582-2a12-49f7-859e-b95f595c8d46 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:34.638115 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-7d8fbc4e-73f1-4f72-ac33-5c94362344de req-26a51582-2a12-49f7-859e-b95f595c8d46 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:34.650438 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-7d8fbc4e-73f1-4f72-ac33-5c94362344de req-26a51582-2a12-49f7-859e-b95f595c8d46 service nova] Creating event network-changed:2900adf5-d18f-4ff5-81c3-7e992ab7af76 for instance 8ccfba99-9116-4274-a24e-1615c1a661fa on hv-cinder-84984 Jul 31 18:39:34.656814 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-7d8fbc4e-73f1-4f72-ac33-5c94362344de req-26a51582-2a12-49f7-859e-b95f595c8d46 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034739 Jul 31 18:39:34.657293 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 156/326] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:39:34.872036 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-1569b83f-56f2-4a62-b53b-a6bf37020643 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:34.872791 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-1569b83f-56f2-4a62-b53b-a6bf37020643 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:34.882285 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1569b83f-56f2-4a62-b53b-a6bf37020643 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:34.882719 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1569b83f-56f2-4a62-b53b-a6bf37020643 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:34.883486 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1569b83f-56f2-4a62-b53b-a6bf37020643 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:34.883919 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1569b83f-56f2-4a62-b53b-a6bf37020643 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:34.913513 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-8282c183-75f7-49dd-a967-b01b920b82c8 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:34.915842 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-8282c183-75f7-49dd-a967-b01b920b82c8 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:34.926524 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8282c183-75f7-49dd-a967-b01b920b82c8 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:34.927257 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8282c183-75f7-49dd-a967-b01b920b82c8 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:34.929054 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8282c183-75f7-49dd-a967-b01b920b82c8 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:34.929648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8282c183-75f7-49dd-a967-b01b920b82c8 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:35.100263 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-1569b83f-56f2-4a62-b53b-a6bf37020643 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:35.110525 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-1569b83f-56f2-4a62-b53b-a6bf37020643 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1724 microversion: 2.1 time: 0.242455 Jul 31 18:39:35.121675 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 171/327] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:34 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:35.136508 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-d6955abb-abdc-4e82-84cf-2cd55ca3b057 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:35.137338 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-d6955abb-abdc-4e82-84cf-2cd55ca3b057 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:35.151438 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d6955abb-abdc-4e82-84cf-2cd55ca3b057 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:35.151892 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d6955abb-abdc-4e82-84cf-2cd55ca3b057 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:35.152746 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d6955abb-abdc-4e82-84cf-2cd55ca3b057 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:35.153512 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d6955abb-abdc-4e82-84cf-2cd55ca3b057 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:35.306566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-8282c183-75f7-49dd-a967-b01b920b82c8 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:35.319920 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-8282c183-75f7-49dd-a967-b01b920b82c8 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1372 microversion: 2.1 time: 0.414521 Jul 31 18:39:35.333177 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 157/328] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:34 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1372 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:35.334075 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-1724ad52-5f6b-4184-8797-d69943e501ff tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:35.336385 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-1724ad52-5f6b-4184-8797-d69943e501ff tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: c7acb0e5-b78a-4c7f-a880-6007ea7be5fe] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:35.353230 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1724ad52-5f6b-4184-8797-d69943e501ff tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:35.353693 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1724ad52-5f6b-4184-8797-d69943e501ff tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:35.354558 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1724ad52-5f6b-4184-8797-d69943e501ff tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:35.355018 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1724ad52-5f6b-4184-8797-d69943e501ff tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:35.377984 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-d6955abb-abdc-4e82-84cf-2cd55ca3b057 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:35.388495 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-d6955abb-abdc-4e82-84cf-2cd55ca3b057 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:35.392177 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-d6955abb-abdc-4e82-84cf-2cd55ca3b057 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:35.393682 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-d6955abb-abdc-4e82-84cf-2cd55ca3b057 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1739 microversion: 2.20 time: 0.268401 Jul 31 18:39:35.410586 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 172/329] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:35 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1739 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:35.674939 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-1724ad52-5f6b-4184-8797-d69943e501ff tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:35.682613 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-1724ad52-5f6b-4184-8797-d69943e501ff tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe" status: 200 len: 1313 microversion: 2.1 time: 0.357032 Jul 31 18:39:35.685412 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 158/330] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:35 2022] GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:36.035414 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-6d7bca2c-bf05-47ef-8b3b-898cf91e0522 req-ca7dd305-9762-4ebe-ab53-bdba415834eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7acb0e5-b78a-4c7f-a880-6007ea7be5fe", "name": "network-vif-plugged", "status": "completed", "tag": "2b22a4bd-e29d-408a-8f48-9420a2fb07da"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:36.053363 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-6d7bca2c-bf05-47ef-8b3b-898cf91e0522 req-ca7dd305-9762-4ebe-ab53-bdba415834eb service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:36.053915 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-6d7bca2c-bf05-47ef-8b3b-898cf91e0522 req-ca7dd305-9762-4ebe-ab53-bdba415834eb service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:36.066894 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-6d7bca2c-bf05-47ef-8b3b-898cf91e0522 req-ca7dd305-9762-4ebe-ab53-bdba415834eb service nova] Creating event network-vif-plugged:2b22a4bd-e29d-408a-8f48-9420a2fb07da for instance c7acb0e5-b78a-4c7f-a880-6007ea7be5fe on hv-cinder-84984 Jul 31 18:39:36.072399 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-6d7bca2c-bf05-47ef-8b3b-898cf91e0522 req-ca7dd305-9762-4ebe-ab53-bdba415834eb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040708 Jul 31 18:39:36.073675 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 173/331] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:39:36.135479 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-488ef9ec-7afb-401f-85dd-dc176197ef57 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:36.136751 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-488ef9ec-7afb-401f-85dd-dc176197ef57 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:36.143661 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-488ef9ec-7afb-401f-85dd-dc176197ef57 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:36.144390 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-488ef9ec-7afb-401f-85dd-dc176197ef57 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:36.149146 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-488ef9ec-7afb-401f-85dd-dc176197ef57 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:36.154154 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-488ef9ec-7afb-401f-85dd-dc176197ef57 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:36.340349 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-320a89ae-b2bf-4b80-aacd-58d9b4c4d44d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:36.341540 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-320a89ae-b2bf-4b80-aacd-58d9b4c4d44d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:36.367116 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-320a89ae-b2bf-4b80-aacd-58d9b4c4d44d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:36.375249 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-320a89ae-b2bf-4b80-aacd-58d9b4c4d44d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:36.376879 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-320a89ae-b2bf-4b80-aacd-58d9b4c4d44d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:36.377908 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-320a89ae-b2bf-4b80-aacd-58d9b4c4d44d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:36.409810 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-488ef9ec-7afb-401f-85dd-dc176197ef57 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:36.425228 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-488ef9ec-7afb-401f-85dd-dc176197ef57 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1724 microversion: 2.1 time: 0.293506 Jul 31 18:39:36.426407 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 159/332] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:36 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1724 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:36.431543 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-b14ad19e-ae05-48d2-9a9f-224f6da9eecf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:36.443301 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-b14ad19e-ae05-48d2-9a9f-224f6da9eecf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:36.461044 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b14ad19e-ae05-48d2-9a9f-224f6da9eecf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:36.461825 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b14ad19e-ae05-48d2-9a9f-224f6da9eecf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:36.462804 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b14ad19e-ae05-48d2-9a9f-224f6da9eecf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:36.463426 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b14ad19e-ae05-48d2-9a9f-224f6da9eecf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:36.589016 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-320a89ae-b2bf-4b80-aacd-58d9b4c4d44d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:36.598458 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-320a89ae-b2bf-4b80-aacd-58d9b4c4d44d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1372 microversion: 2.1 time: 0.262037 Jul 31 18:39:36.600980 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 174/333] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:36 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1372 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:39:36.692097 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-b14ad19e-ae05-48d2-9a9f-224f6da9eecf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:36.700346 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-b14ad19e-ae05-48d2-9a9f-224f6da9eecf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:36.702339 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-b14ad19e-ae05-48d2-9a9f-224f6da9eecf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:36.703539 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-b14ad19e-ae05-48d2-9a9f-224f6da9eecf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1739 microversion: 2.20 time: 0.275667 Jul 31 18:39:36.704258 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 160/334] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:36 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1739 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:36.769848 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-0d5a7dd5-948c-44c1-a148-570937d78ca0 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:36.770463 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-0d5a7dd5-948c-44c1-a148-570937d78ca0 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: c7acb0e5-b78a-4c7f-a880-6007ea7be5fe] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:36.778112 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0d5a7dd5-948c-44c1-a148-570937d78ca0 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:36.778648 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0d5a7dd5-948c-44c1-a148-570937d78ca0 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:36.779560 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0d5a7dd5-948c-44c1-a148-570937d78ca0 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:36.779997 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0d5a7dd5-948c-44c1-a148-570937d78ca0 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:36.922038 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-0d5a7dd5-948c-44c1-a148-570937d78ca0 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:36.929985 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-0d5a7dd5-948c-44c1-a148-570937d78ca0 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe" status: 200 len: 1313 microversion: 2.1 time: 0.164119 Jul 31 18:39:36.943302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 175/335] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:36 2022] GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:37.446078 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-358088dc-095d-4b94-93fe-758843ce379c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:37.447676 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-358088dc-095d-4b94-93fe-758843ce379c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:37.454090 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell0:SELECT=18 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:37.456266 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-358088dc-095d-4b94-93fe-758843ce379c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:37.457044 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-358088dc-095d-4b94-93fe-758843ce379c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:37.458217 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-358088dc-095d-4b94-93fe-758843ce379c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:37.458983 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-358088dc-095d-4b94-93fe-758843ce379c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:37.619998 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-b8a4c05b-febf-41eb-a3a9-2a6727dc644b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:37.620741 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-b8a4c05b-febf-41eb-a3a9-2a6727dc644b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:37.624533 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell0:SELECT=4 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:37.624688 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-358088dc-095d-4b94-93fe-758843ce379c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:37.626049 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell0:SELECT=14 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:37.634053 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b8a4c05b-febf-41eb-a3a9-2a6727dc644b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:37.634941 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b8a4c05b-febf-41eb-a3a9-2a6727dc644b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:37.636116 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b8a4c05b-febf-41eb-a3a9-2a6727dc644b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:37.637113 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b8a4c05b-febf-41eb-a3a9-2a6727dc644b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:37.641176 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-358088dc-095d-4b94-93fe-758843ce379c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1724 microversion: 2.1 time: 0.197048 Jul 31 18:39:37.642212 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 161/336] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:37 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:37.727195 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-d50efb03-c390-4cf6-952e-ef20dc5d2e3d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:37.727786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-d50efb03-c390-4cf6-952e-ef20dc5d2e3d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:37.738744 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d50efb03-c390-4cf6-952e-ef20dc5d2e3d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:37.739342 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d50efb03-c390-4cf6-952e-ef20dc5d2e3d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:37.740804 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d50efb03-c390-4cf6-952e-ef20dc5d2e3d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:37.740804 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d50efb03-c390-4cf6-952e-ef20dc5d2e3d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:37.838533 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-b8a4c05b-febf-41eb-a3a9-2a6727dc644b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:37.847772 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-b8a4c05b-febf-41eb-a3a9-2a6727dc644b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1372 microversion: 2.1 time: 0.231673 Jul 31 18:39:37.861996 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 176/337] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:37 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1372 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:37.914591 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-d50efb03-c390-4cf6-952e-ef20dc5d2e3d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:37.923332 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-d50efb03-c390-4cf6-952e-ef20dc5d2e3d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:37.924862 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-d50efb03-c390-4cf6-952e-ef20dc5d2e3d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:37.926115 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-d50efb03-c390-4cf6-952e-ef20dc5d2e3d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1739 microversion: 2.20 time: 0.203072 Jul 31 18:39:37.926672 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 162/338] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:37 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:37.954897 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-24a85cfe-f9a6-45ab-a11a-2f4e29c5fec3 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:37.956665 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-24a85cfe-f9a6-45ab-a11a-2f4e29c5fec3 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: c7acb0e5-b78a-4c7f-a880-6007ea7be5fe] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:37.963676 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-24a85cfe-f9a6-45ab-a11a-2f4e29c5fec3 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:37.964112 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-24a85cfe-f9a6-45ab-a11a-2f4e29c5fec3 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:37.964903 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-24a85cfe-f9a6-45ab-a11a-2f4e29c5fec3 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:37.965327 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-24a85cfe-f9a6-45ab-a11a-2f4e29c5fec3 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:38.119256 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-24a85cfe-f9a6-45ab-a11a-2f4e29c5fec3 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:38.129415 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-24a85cfe-f9a6-45ab-a11a-2f4e29c5fec3 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe" status: 200 len: 1313 microversion: 2.1 time: 0.182188 Jul 31 18:39:38.130553 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 177/339] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:37 2022] GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:38.664213 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-3cfbbbe7-3dce-4d82-ad43-557f437ac0f5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:38.666164 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-3cfbbbe7-3dce-4d82-ad43-557f437ac0f5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:38.675469 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3cfbbbe7-3dce-4d82-ad43-557f437ac0f5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:38.676293 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3cfbbbe7-3dce-4d82-ad43-557f437ac0f5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:38.677370 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3cfbbbe7-3dce-4d82-ad43-557f437ac0f5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:38.677796 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3cfbbbe7-3dce-4d82-ad43-557f437ac0f5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:38.835771 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-3cfbbbe7-3dce-4d82-ad43-557f437ac0f5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:38.844846 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-3cfbbbe7-3dce-4d82-ad43-557f437ac0f5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1724 microversion: 2.1 time: 0.185330 Jul 31 18:39:38.846037 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 163/340] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:38 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:38.869276 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-7318134d-2659-446f-a05f-07f27cca57f3 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:38.869875 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-7318134d-2659-446f-a05f-07f27cca57f3 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:38.880888 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7318134d-2659-446f-a05f-07f27cca57f3 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:38.883043 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7318134d-2659-446f-a05f-07f27cca57f3 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:38.884522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7318134d-2659-446f-a05f-07f27cca57f3 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:38.886956 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7318134d-2659-446f-a05f-07f27cca57f3 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:38.951876 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-71555c6f-12be-4045-bb10-d6ec346c31a0 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:38.952483 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-71555c6f-12be-4045-bb10-d6ec346c31a0 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:38.959045 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-71555c6f-12be-4045-bb10-d6ec346c31a0 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:38.959909 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-71555c6f-12be-4045-bb10-d6ec346c31a0 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:38.960264 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-71555c6f-12be-4045-bb10-d6ec346c31a0 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:38.960696 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-71555c6f-12be-4045-bb10-d6ec346c31a0 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:39.052121 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-7318134d-2659-446f-a05f-07f27cca57f3 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:39.059696 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-7318134d-2659-446f-a05f-07f27cca57f3 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1372 microversion: 2.1 time: 0.194227 Jul 31 18:39:39.060550 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 178/341] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:38 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1372 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:39:39.113917 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-71555c6f-12be-4045-bb10-d6ec346c31a0 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:39.122103 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-71555c6f-12be-4045-bb10-d6ec346c31a0 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:39.123749 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-71555c6f-12be-4045-bb10-d6ec346c31a0 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:39.124920 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-71555c6f-12be-4045-bb10-d6ec346c31a0 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1739 microversion: 2.20 time: 0.177035 Jul 31 18:39:39.126024 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 164/342] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:38 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:39.150572 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-8dc133b6-0ab8-4008-ba22-a703e409dc84 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:39.150978 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-8dc133b6-0ab8-4008-ba22-a703e409dc84 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: c7acb0e5-b78a-4c7f-a880-6007ea7be5fe] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:39.157627 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8dc133b6-0ab8-4008-ba22-a703e409dc84 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:39.158123 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8dc133b6-0ab8-4008-ba22-a703e409dc84 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:39.158897 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8dc133b6-0ab8-4008-ba22-a703e409dc84 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:39.159333 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8dc133b6-0ab8-4008-ba22-a703e409dc84 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:39.300406 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-8dc133b6-0ab8-4008-ba22-a703e409dc84 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:39.309063 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-8dc133b6-0ab8-4008-ba22-a703e409dc84 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe" status: 200 len: 1495 microversion: 2.1 time: 0.162302 Jul 31 18:39:39.309796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 179/343] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:39 2022] GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe => generated 1495 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:39.588992 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-94f6e7d3-67e8-40c2-8a8e-873445c517cc req-27138fd5-5c61-4536-84d1-3a10bf2d0ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4377ead1-89c3-4e21-b45c-c20dcf7bacf9", "name": "network-vif-plugged", "status": "completed", "tag": "4200cac4-2be0-4499-a408-eff0761571a8"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:39.604566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-94f6e7d3-67e8-40c2-8a8e-873445c517cc req-27138fd5-5c61-4536-84d1-3a10bf2d0ab9 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:39.605043 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-94f6e7d3-67e8-40c2-8a8e-873445c517cc req-27138fd5-5c61-4536-84d1-3a10bf2d0ab9 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:39.621751 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-94f6e7d3-67e8-40c2-8a8e-873445c517cc req-27138fd5-5c61-4536-84d1-3a10bf2d0ab9 service nova] Creating event network-vif-plugged:4200cac4-2be0-4499-a408-eff0761571a8 for instance 4377ead1-89c3-4e21-b45c-c20dcf7bacf9 on hv-cinder-84984 Jul 31 18:39:39.627957 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-94f6e7d3-67e8-40c2-8a8e-873445c517cc req-27138fd5-5c61-4536-84d1-3a10bf2d0ab9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042788 Jul 31 18:39:39.629675 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 165/344] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:39:39.816161 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-022525ca-a1f7-49ec-b1f8-01c94abf5834 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:39.816649 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-022525ca-a1f7-49ec-b1f8-01c94abf5834 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: c7acb0e5-b78a-4c7f-a880-6007ea7be5fe] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:39.823379 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-022525ca-a1f7-49ec-b1f8-01c94abf5834 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:39.823762 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-022525ca-a1f7-49ec-b1f8-01c94abf5834 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:39.824526 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-022525ca-a1f7-49ec-b1f8-01c94abf5834 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:39.824996 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-022525ca-a1f7-49ec-b1f8-01c94abf5834 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:39.854672 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-022525ca-a1f7-49ec-b1f8-01c94abf5834 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: c7acb0e5-b78a-4c7f-a880-6007ea7be5fe] Going to try to terminate instance {{(pid=124334) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 18:39:39.867852 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-3184deea-1c18-4e3a-8173-446067209fd5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:39.869361 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-3184deea-1c18-4e3a-8173-446067209fd5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:39.882929 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3184deea-1c18-4e3a-8173-446067209fd5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:39.883655 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3184deea-1c18-4e3a-8173-446067209fd5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:39.884578 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3184deea-1c18-4e3a-8173-446067209fd5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:39.887923 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3184deea-1c18-4e3a-8173-446067209fd5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:40.017021 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-022525ca-a1f7-49ec-b1f8-01c94abf5834 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe" status: 204 len: 0 microversion: 2.1 time: 0.202345 Jul 31 18:39:40.021977 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 180/345] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:39:39 2022] DELETE /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 18:39:40.033354 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-e12866f5-e139-440c-8b11-1115e05233aa tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:40.034046 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-e12866f5-e139-440c-8b11-1115e05233aa tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: c7acb0e5-b78a-4c7f-a880-6007ea7be5fe] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:40.041097 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e12866f5-e139-440c-8b11-1115e05233aa tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:40.041541 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e12866f5-e139-440c-8b11-1115e05233aa tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:40.042312 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e12866f5-e139-440c-8b11-1115e05233aa tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:40.042741 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e12866f5-e139-440c-8b11-1115e05233aa tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:40.079985 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-3184deea-1c18-4e3a-8173-446067209fd5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:40.088482 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-3184deea-1c18-4e3a-8173-446067209fd5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1724 microversion: 2.1 time: 0.225098 Jul 31 18:39:40.102536 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 166/346] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:39 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:39:40.107605 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-5c23d8c1-1572-47a7-a28d-d23194867903 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:40.108327 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-5c23d8c1-1572-47a7-a28d-d23194867903 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:40.115494 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5c23d8c1-1572-47a7-a28d-d23194867903 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:40.115891 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5c23d8c1-1572-47a7-a28d-d23194867903 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:40.116783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5c23d8c1-1572-47a7-a28d-d23194867903 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:40.117325 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5c23d8c1-1572-47a7-a28d-d23194867903 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:40.206427 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-e12866f5-e139-440c-8b11-1115e05233aa tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:40.214653 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-e12866f5-e139-440c-8b11-1115e05233aa tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe" status: 200 len: 1501 microversion: 2.1 time: 0.191291 Jul 31 18:39:40.215730 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 181/347] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:40 2022] GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe => generated 1501 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:39:40.221937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-6b381202-2b68-46a3-bc42-f9e6092e65db tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:40.222551 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-6b381202-2b68-46a3-bc42-f9e6092e65db tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:40.231584 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6b381202-2b68-46a3-bc42-f9e6092e65db tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:40.232108 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6b381202-2b68-46a3-bc42-f9e6092e65db tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:40.232949 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6b381202-2b68-46a3-bc42-f9e6092e65db tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:40.233393 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6b381202-2b68-46a3-bc42-f9e6092e65db tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:40.236387 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:40.279606 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-5c23d8c1-1572-47a7-a28d-d23194867903 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:40.288230 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-5c23d8c1-1572-47a7-a28d-d23194867903 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1372 microversion: 2.1 time: 0.184393 Jul 31 18:39:40.288938 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 167/348] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:40 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1372 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:40.387411 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-6b381202-2b68-46a3-bc42-f9e6092e65db tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:40.395976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-6b381202-2b68-46a3-bc42-f9e6092e65db tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:40.397737 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-6b381202-2b68-46a3-bc42-f9e6092e65db tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:40.398974 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-6b381202-2b68-46a3-bc42-f9e6092e65db tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1739 microversion: 2.20 time: 0.182806 Jul 31 18:39:40.413616 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 182/349] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:40 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:41.109891 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-2c9c462c-a81e-41d5-8fcf-82cf58ee726e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:41.110496 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-2c9c462c-a81e-41d5-8fcf-82cf58ee726e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:41.117249 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2c9c462c-a81e-41d5-8fcf-82cf58ee726e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:41.117685 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2c9c462c-a81e-41d5-8fcf-82cf58ee726e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:41.118455 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2c9c462c-a81e-41d5-8fcf-82cf58ee726e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:41.118864 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2c9c462c-a81e-41d5-8fcf-82cf58ee726e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:41.138966 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=100 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:41.235549 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-2a44fbe7-0490-447d-b34c-46883d26c375 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:41.236168 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-2a44fbe7-0490-447d-b34c-46883d26c375 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: c7acb0e5-b78a-4c7f-a880-6007ea7be5fe] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:41.242478 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2a44fbe7-0490-447d-b34c-46883d26c375 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:41.242921 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2a44fbe7-0490-447d-b34c-46883d26c375 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:41.243688 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2a44fbe7-0490-447d-b34c-46883d26c375 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:41.244124 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2a44fbe7-0490-447d-b34c-46883d26c375 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:41.290944 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-2c9c462c-a81e-41d5-8fcf-82cf58ee726e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:41.299361 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-2c9c462c-a81e-41d5-8fcf-82cf58ee726e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1724 microversion: 2.1 time: 0.193257 Jul 31 18:39:41.314417 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 168/350] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:41 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:41.319795 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-7eb525c0-a486-465a-9520-c29c3685fe69 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:41.320497 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-7eb525c0-a486-465a-9520-c29c3685fe69 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:41.327377 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7eb525c0-a486-465a-9520-c29c3685fe69 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:41.327856 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7eb525c0-a486-465a-9520-c29c3685fe69 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:41.328629 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7eb525c0-a486-465a-9520-c29c3685fe69 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:41.329085 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7eb525c0-a486-465a-9520-c29c3685fe69 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:41.409443 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-2a44fbe7-0490-447d-b34c-46883d26c375 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:41.419652 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-2a44fbe7-0490-447d-b34c-46883d26c375 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe" status: 200 len: 1501 microversion: 2.1 time: 0.187836 Jul 31 18:39:41.420416 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 183/351] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:41 2022] GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe => generated 1501 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:41.426648 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-1cc35851-4092-4606-8554-2cd01481363e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:41.427390 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-1cc35851-4092-4606-8554-2cd01481363e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:41.440040 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1cc35851-4092-4606-8554-2cd01481363e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:41.440634 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1cc35851-4092-4606-8554-2cd01481363e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:41.441704 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1cc35851-4092-4606-8554-2cd01481363e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:41.442320 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1cc35851-4092-4606-8554-2cd01481363e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:41.514984 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-7eb525c0-a486-465a-9520-c29c3685fe69 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:41.524259 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-7eb525c0-a486-465a-9520-c29c3685fe69 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1372 microversion: 2.1 time: 0.208708 Jul 31 18:39:41.527436 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 169/352] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:41 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1372 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:41.591226 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-1cc35851-4092-4606-8554-2cd01481363e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:41.599983 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-1cc35851-4092-4606-8554-2cd01481363e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:41.601724 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-1cc35851-4092-4606-8554-2cd01481363e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:41.603001 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-1cc35851-4092-4606-8554-2cd01481363e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1739 microversion: 2.20 time: 0.180644 Jul 31 18:39:41.617080 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 184/353] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:41 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:42.320814 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-0ea496da-39b3-40e2-a593-9632a84e3bbc tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:42.321428 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-0ea496da-39b3-40e2-a593-9632a84e3bbc tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:42.328461 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0ea496da-39b3-40e2-a593-9632a84e3bbc tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:42.328932 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0ea496da-39b3-40e2-a593-9632a84e3bbc tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:42.329697 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0ea496da-39b3-40e2-a593-9632a84e3bbc tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:42.330122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0ea496da-39b3-40e2-a593-9632a84e3bbc tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:42.441081 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-e634ae4d-f678-40ce-90c7-697506722605 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:42.441786 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-e634ae4d-f678-40ce-90c7-697506722605 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: c7acb0e5-b78a-4c7f-a880-6007ea7be5fe] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:42.448845 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e634ae4d-f678-40ce-90c7-697506722605 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:42.449779 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e634ae4d-f678-40ce-90c7-697506722605 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:42.450835 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e634ae4d-f678-40ce-90c7-697506722605 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:42.451486 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e634ae4d-f678-40ce-90c7-697506722605 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:42.605820 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-e634ae4d-f678-40ce-90c7-697506722605 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:42.613567 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-e634ae4d-f678-40ce-90c7-697506722605 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe" status: 200 len: 1501 microversion: 2.1 time: 0.176422 Jul 31 18:39:42.615963 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-0ea496da-39b3-40e2-a593-9632a84e3bbc tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:42.627492 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 185/354] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:42 2022] GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe => generated 1501 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:39:42.632009 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-0ea496da-39b3-40e2-a593-9632a84e3bbc tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1701 microversion: 2.1 time: 0.315091 Jul 31 18:39:42.633251 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 170/355] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:42 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1701 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:42.633671 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-a231adb6-55eb-4e47-802d-27e193b932b0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:42.634442 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-a231adb6-55eb-4e47-802d-27e193b932b0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:42.640656 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a231adb6-55eb-4e47-802d-27e193b932b0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:42.641153 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a231adb6-55eb-4e47-802d-27e193b932b0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:42.641570 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-814bf2d8-9820-4de5-8cc9-bb27e24df609 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:42.641932 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a231adb6-55eb-4e47-802d-27e193b932b0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:42.642251 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-814bf2d8-9820-4de5-8cc9-bb27e24df609 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:42.642694 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a231adb6-55eb-4e47-802d-27e193b932b0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:42.648910 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-814bf2d8-9820-4de5-8cc9-bb27e24df609 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:42.649615 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-814bf2d8-9820-4de5-8cc9-bb27e24df609 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:42.650636 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-814bf2d8-9820-4de5-8cc9-bb27e24df609 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:42.651140 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-814bf2d8-9820-4de5-8cc9-bb27e24df609 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:42.785174 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-a231adb6-55eb-4e47-802d-27e193b932b0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:42.792783 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-a231adb6-55eb-4e47-802d-27e193b932b0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1372 microversion: 2.1 time: 0.164042 Jul 31 18:39:42.793372 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 186/356] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:42 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:42.797974 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-1edab388-cc7c-4339-8312-a5c85fcbab76 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:42.803829 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1edab388-cc7c-4339-8312-a5c85fcbab76 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:42.804273 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1edab388-cc7c-4339-8312-a5c85fcbab76 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:42.836640 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-814bf2d8-9820-4de5-8cc9-bb27e24df609 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:42.846920 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-814bf2d8-9820-4de5-8cc9-bb27e24df609 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:42.848854 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-814bf2d8-9820-4de5-8cc9-bb27e24df609 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:42.850213 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-814bf2d8-9820-4de5-8cc9-bb27e24df609 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1739 microversion: 2.20 time: 0.216013 Jul 31 18:39:42.850759 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 171/357] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:42 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1739 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:42.871308 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-1edab388-cc7c-4339-8312-a5c85fcbab76 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Going to try to start instance {{(pid=124334) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 31 18:39:42.919259 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-1edab388-cc7c-4339-8312-a5c85fcbab76 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "POST /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92/action" status: 202 len: 0 microversion: 2.1 time: 0.124673 Jul 31 18:39:42.919876 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 187/358] 10.222.0.49 () {60 vars in 1278 bytes} [Sun Jul 31 18:39:42 2022] POST /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:39:42.927203 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-60909727-ad31-4bfd-a9d0-912862c0e357 req-3a77464f-84a4-4895-8415-0b856a97a0ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7acb0e5-b78a-4c7f-a880-6007ea7be5fe", "name": "network-vif-deleted", "tag": "2b22a4bd-e29d-408a-8f48-9420a2fb07da"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:42.929191 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-0383c6ae-acf1-4518-9724-abfb48498516 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:42.929948 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-0383c6ae-acf1-4518-9724-abfb48498516 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:42.936305 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0383c6ae-acf1-4518-9724-abfb48498516 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:42.936840 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0383c6ae-acf1-4518-9724-abfb48498516 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:42.937155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-60909727-ad31-4bfd-a9d0-912862c0e357 req-3a77464f-84a4-4895-8415-0b856a97a0ae service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:42.937625 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-60909727-ad31-4bfd-a9d0-912862c0e357 req-3a77464f-84a4-4895-8415-0b856a97a0ae service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:42.937737 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0383c6ae-acf1-4518-9724-abfb48498516 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:42.938282 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0383c6ae-acf1-4518-9724-abfb48498516 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:42.948618 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-60909727-ad31-4bfd-a9d0-912862c0e357 req-3a77464f-84a4-4895-8415-0b856a97a0ae service nova] Creating event network-vif-deleted:2b22a4bd-e29d-408a-8f48-9420a2fb07da for instance c7acb0e5-b78a-4c7f-a880-6007ea7be5fe on hv-cinder-84984 Jul 31 18:39:42.953583 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-60909727-ad31-4bfd-a9d0-912862c0e357 req-3a77464f-84a4-4895-8415-0b856a97a0ae service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030109 Jul 31 18:39:42.954175 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 172/359] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:39:43.073278 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-0383c6ae-acf1-4518-9724-abfb48498516 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:43.081664 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-0383c6ae-acf1-4518-9724-abfb48498516 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1710 microversion: 2.1 time: 0.156421 Jul 31 18:39:43.082237 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 188/360] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:42 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1710 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:39:43.640335 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-257e82c8-6ebc-41a6-857d-ee9eddd4bc6c tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:43.641505 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-257e82c8-6ebc-41a6-857d-ee9eddd4bc6c tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: c7acb0e5-b78a-4c7f-a880-6007ea7be5fe] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:43.652114 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-257e82c8-6ebc-41a6-857d-ee9eddd4bc6c tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:43.652977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-257e82c8-6ebc-41a6-857d-ee9eddd4bc6c tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:43.654176 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-257e82c8-6ebc-41a6-857d-ee9eddd4bc6c tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:43.654604 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-257e82c8-6ebc-41a6-857d-ee9eddd4bc6c tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:43.686316 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-257e82c8-6ebc-41a6-857d-ee9eddd4bc6c tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:43.686757 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-257e82c8-6ebc-41a6-857d-ee9eddd4bc6c tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:43.687195 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.objects.instance [None req-257e82c8-6ebc-41a6-857d-ee9eddd4bc6c tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lazy-loading 'fault' on Instance uuid c7acb0e5-b78a-4c7f-a880-6007ea7be5fe {{(pid=124333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:39:43.729477 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-257e82c8-6ebc-41a6-857d-ee9eddd4bc6c tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:43.737361 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-257e82c8-6ebc-41a6-857d-ee9eddd4bc6c tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe" status: 200 len: 1303 microversion: 2.1 time: 0.104891 Jul 31 18:39:43.737930 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 173/361] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:43 2022] GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe => generated 1303 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:43.818175 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-b8fe0533-7cac-4edf-8045-55fdc9c72b61 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:43.819140 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-b8fe0533-7cac-4edf-8045-55fdc9c72b61 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:43.828854 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b8fe0533-7cac-4edf-8045-55fdc9c72b61 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:43.829303 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b8fe0533-7cac-4edf-8045-55fdc9c72b61 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:43.830096 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b8fe0533-7cac-4edf-8045-55fdc9c72b61 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:43.830573 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b8fe0533-7cac-4edf-8045-55fdc9c72b61 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:43.877711 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-31b5f4ce-40c1-41bb-a8f8-3fb21010f242 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:43.878666 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-31b5f4ce-40c1-41bb-a8f8-3fb21010f242 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:43.892013 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-31b5f4ce-40c1-41bb-a8f8-3fb21010f242 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:43.892801 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-31b5f4ce-40c1-41bb-a8f8-3fb21010f242 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:43.894204 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-31b5f4ce-40c1-41bb-a8f8-3fb21010f242 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:43.894790 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-31b5f4ce-40c1-41bb-a8f8-3fb21010f242 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:43.987671 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-b8fe0533-7cac-4edf-8045-55fdc9c72b61 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:43.995147 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-b8fe0533-7cac-4edf-8045-55fdc9c72b61 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1566 microversion: 2.1 time: 0.183561 Jul 31 18:39:43.995812 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 189/362] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:43 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:44.016950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-40b56cd6-b670-4500-bdfb-55141d5ed9f0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:44.017586 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-40b56cd6-b670-4500-bdfb-55141d5ed9f0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:44.023908 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-40b56cd6-b670-4500-bdfb-55141d5ed9f0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:44.024400 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-40b56cd6-b670-4500-bdfb-55141d5ed9f0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:44.025225 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-40b56cd6-b670-4500-bdfb-55141d5ed9f0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:44.025662 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-40b56cd6-b670-4500-bdfb-55141d5ed9f0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:44.116155 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-40b56cd6-b670-4500-bdfb-55141d5ed9f0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102650 Jul 31 18:39:44.117505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 190/363] 10.222.0.49 () {58 vars in 1275 bytes} [Sun Jul 31 18:39:44 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:39:44.126195 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-85728abb-c9af-41c1-828b-4fa4caeeb456 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:44.126888 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-85728abb-c9af-41c1-828b-4fa4caeeb456 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:44.137794 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-85728abb-c9af-41c1-828b-4fa4caeeb456 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:44.138400 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-85728abb-c9af-41c1-828b-4fa4caeeb456 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:44.139248 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-85728abb-c9af-41c1-828b-4fa4caeeb456 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:44.139750 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-85728abb-c9af-41c1-828b-4fa4caeeb456 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:44.174432 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-31b5f4ce-40c1-41bb-a8f8-3fb21010f242 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:44.185061 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-31b5f4ce-40c1-41bb-a8f8-3fb21010f242 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:44.187645 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-31b5f4ce-40c1-41bb-a8f8-3fb21010f242 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:44.189098 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-31b5f4ce-40c1-41bb-a8f8-3fb21010f242 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1739 microversion: 2.20 time: 0.318651 Jul 31 18:39:44.189905 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 174/364] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:43 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1739 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:44.657255 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-85728abb-c9af-41c1-828b-4fa4caeeb456 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:44.666692 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-85728abb-c9af-41c1-828b-4fa4caeeb456 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1710 microversion: 2.1 time: 0.547797 Jul 31 18:39:44.680661 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 191/365] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:44 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1710 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:44.761336 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-063b70e3-2166-4b45-a474-b74e691a3b5f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:44.762780 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-063b70e3-2166-4b45-a474-b74e691a3b5f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: c7acb0e5-b78a-4c7f-a880-6007ea7be5fe] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:44.771694 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-063b70e3-2166-4b45-a474-b74e691a3b5f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:44.772130 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-063b70e3-2166-4b45-a474-b74e691a3b5f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:44.772930 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-063b70e3-2166-4b45-a474-b74e691a3b5f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:44.773356 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-063b70e3-2166-4b45-a474-b74e691a3b5f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:44.790720 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-063b70e3-2166-4b45-a474-b74e691a3b5f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] HTTP exception thrown: Instance c7acb0e5-b78a-4c7f-a880-6007ea7be5fe could not be found. Jul 31 18:39:44.792473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-063b70e3-2166-4b45-a474-b74e691a3b5f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Request method failure captured: Jul 31 18:39:44.792473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe HTTP/1.1 Jul 31 18:39:44.792473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:39:44.792473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:39:44.792473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:39:44.792473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:39:44.792473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:39:44.792473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:39:44.792473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:39:44.792473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:39:44.792473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5sxbWF-fkBYz2WxYFI5lgetH7DEHdhk9u6IjRa4kU7MxhDySZxBk-s2D0bv2dYibhjfm5AAF8ULEAV5srhBr8qa4WtOHMmR5IdR0m1Yefb4qdaKVyBARWt4njUGokWmuuVxkLQNo6vv_ro43RoLBF05L64ixU22O41-CuDZgnsBlhks Jul 31 18:39:44.792473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:39:44.792473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:39:44.792473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:39:44.792473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:39:44.792473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:39:44.792473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:39:44.792473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: 91867ca69f334c76a3671331612ea954 Jul 31 18:39:44.792473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-VolumesActionsTest-1855021462 Jul 31 18:39:44.792473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:39:44.792473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:39:44.794049 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/91867ca69f334c76a3671331612ea954"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_91867ca69f334c76a3671331612ea954", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/91867ca69f334c76a3671331612ea954"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/91867ca69f334c76a3671331612ea954"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:39:44.794049 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-VolumesActionsTest-1855021462 Jul 31 18:39:44.794049 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: 91867ca69f334c76a3671331612ea954 Jul 31 18:39:44.794049 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-VolumesActionsTest-1855021462 Jul 31 18:39:44.794049 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-VolumesActionsTest-1855021462-project Jul 31 18:39:44.794049 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:39:44.794049 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:39:44.794049 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 0e0a63102acb43158fb074f468ca2faf Jul 31 18:39:44.794049 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-VolumesActionsTest-1855021462-project Jul 31 18:39:44.794049 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: > Jul 31 18:39:44.794049 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Instance c7acb0e5-b78a-4c7f-a880-6007ea7be5fe could not be found. Jul 31 18:39:44.794049 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': 'c7acb0e5-b78a-4c7f-a880-6007ea7be5fe'} Jul 31 18:39:44.795101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:39:44.795101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:39:44.795101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:39:44.795101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:39:44.795101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:39:44.795101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:39:44.795101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:39:44.795101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:39:44.795101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:39:44.795101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:39:44.795101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7acb0e5-b78a-4c7f-a880-6007ea7be5fe could not be found. Jul 31 18:39:44.795101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:39:44.795101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:39:44.795101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:39:44.795101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:39:44.795101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:39:44.795101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:39:44.795101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:39:44.795101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:39:44.795101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:39:44.796483 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:39:44.796483 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:39:44.796483 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:39:44.796483 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:39:44.796483 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:39:44.796483 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:39:44.796483 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:39:44.796483 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7acb0e5-b78a-4c7f-a880-6007ea7be5fe could not be found. Jul 31 18:39:44.796483 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:39:44.796483 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:39:44.796483 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:39:44.796483 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:39:44.796483 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:39:44.796483 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:39:44.796483 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:39:44.796483 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:39:44.796483 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7acb0e5-b78a-4c7f-a880-6007ea7be5fe could not be found. Jul 31 18:39:44.796483 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:39:44.797723 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-063b70e3-2166-4b45-a474-b74e691a3b5f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Returning 404 to user: Instance c7acb0e5-b78a-4c7f-a880-6007ea7be5fe could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:39:44.797723 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-063b70e3-2166-4b45-a474-b74e691a3b5f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe" status: 404 len: 111 microversion: 2.1 time: 0.038584 Jul 31 18:39:44.797723 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 175/366] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:44 2022] GET /compute/v2.1/servers/c7acb0e5-b78a-4c7f-a880-6007ea7be5fe => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:39:44.848336 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-50d10b04-59ce-46f5-98d5-a869b2e8fb81 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1213617961", "imageRef": "6f2a0bb6-2fb3-4536-bee3-23e4e975f079", "flavorRef": "452", "networks": [{"uuid": "c50e1e61-1500-4bfb-8d85-b78aab4ac006"}]}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:44.906149 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.network.neutron [None req-50d10b04-59ce-46f5-98d5-a869b2e8fb81 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] validate_networks() for [('c50e1e61-1500-4bfb-8d85-b78aab4ac006', None, None, None, None, None)] {{(pid=124334) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 18:39:45.212919 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-af2c138d-3246-4910-9614-566c8ec57d12 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:45.213571 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-af2c138d-3246-4910-9614-566c8ec57d12 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:45.220308 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-af2c138d-3246-4910-9614-566c8ec57d12 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:45.220746 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-af2c138d-3246-4910-9614-566c8ec57d12 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:45.226425 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-af2c138d-3246-4910-9614-566c8ec57d12 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:45.226425 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-af2c138d-3246-4910-9614-566c8ec57d12 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:45.357480 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-af2c138d-3246-4910-9614-566c8ec57d12 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:45.365812 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-af2c138d-3246-4910-9614-566c8ec57d12 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:45.367301 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-af2c138d-3246-4910-9614-566c8ec57d12 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:45.368490 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-af2c138d-3246-4910-9614-566c8ec57d12 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1721 microversion: 2.20 time: 0.159672 Jul 31 18:39:45.369058 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 176/367] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:45 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:45.487524 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-50d10b04-59ce-46f5-98d5-a869b2e8fb81 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Flavor limits 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 18:39:45.487677 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-50d10b04-59ce-46f5-98d5-a869b2e8fb81 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Image limits 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 18:39:45.488250 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-50d10b04-59ce-46f5-98d5-a869b2e8fb81 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Flavor pref 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 18:39:45.488537 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-50d10b04-59ce-46f5-98d5-a869b2e8fb81 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Image pref 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 18:39:45.490146 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-50d10b04-59ce-46f5-98d5-a869b2e8fb81 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 18:39:45.498630 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-50d10b04-59ce-46f5-98d5-a869b2e8fb81 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:45.499081 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-50d10b04-59ce-46f5-98d5-a869b2e8fb81 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:45.499889 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-50d10b04-59ce-46f5-98d5-a869b2e8fb81 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:45.500331 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-50d10b04-59ce-46f5-98d5-a869b2e8fb81 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:45.519127 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.quota [None req-50d10b04-59ce-46f5-98d5-a869b2e8fb81 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Getting quotas for project 91867ca69f334c76a3671331612ea954. Resources: {'cores', 'ram', 'instances'} {{(pid=124334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:39:45.523273 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.quota [None req-50d10b04-59ce-46f5-98d5-a869b2e8fb81 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Getting quotas for user 0e0a63102acb43158fb074f468ca2faf and project 91867ca69f334c76a3671331612ea954. Resources: {'cores', 'ram', 'instances'} {{(pid=124334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:39:45.534649 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-50d10b04-59ce-46f5-98d5-a869b2e8fb81 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Going to run 1 instances... {{(pid=124334) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 18:39:45.536968 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-50d10b04-59ce-46f5-98d5-a869b2e8fb81 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f2a0bb6-2fb3-4536-bee3-23e4e975f079',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 18:39:45.573144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-4b98d133-337c-436d-a7ba-dab177d8e7a2 req-77c899d5-dfea-479c-ac68-24ce094ff238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "432e6c6a-9a11-4f18-8dbe-fbb82e95f39f", "name": "network-vif-unplugged", "status": "completed", "tag": "2a079287-92d9-4c25-bdec-babc0efb1738"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:45.587074 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-4b98d133-337c-436d-a7ba-dab177d8e7a2 req-77c899d5-dfea-479c-ac68-24ce094ff238 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:45.588168 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-4b98d133-337c-436d-a7ba-dab177d8e7a2 req-77c899d5-dfea-479c-ac68-24ce094ff238 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:45.592450 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-50d10b04-59ce-46f5-98d5-a869b2e8fb81 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.748319 Jul 31 18:39:45.593135 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 192/368] 10.222.0.49 () {60 vars in 1147 bytes} [Sun Jul 31 18:39:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 18:39:45.605255 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f5031fd5-c21a-44d6-bb57-8651cf488b78 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:45.606157 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-f5031fd5-c21a-44d6-bb57-8651cf488b78 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:45.635381 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-4b98d133-337c-436d-a7ba-dab177d8e7a2 req-77c899d5-dfea-479c-ac68-24ce094ff238 service nova] Creating event network-vif-unplugged:2a079287-92d9-4c25-bdec-babc0efb1738 for instance 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f on hv-cinder-84984 Jul 31 18:39:45.641780 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-4b98d133-337c-436d-a7ba-dab177d8e7a2 req-77c899d5-dfea-479c-ac68-24ce094ff238 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072801 Jul 31 18:39:45.642859 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 177/369] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:39:45.682123 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-904978d2-4f8b-4fe8-b839-613e563a2926 req-09c6b67a-1d8e-44a0-af9a-46bc597196ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4377ead1-89c3-4e21-b45c-c20dcf7bacf9", "tag": "4200cac4-2be0-4499-a408-eff0761571a8"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:45.685991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-f5031fd5-c21a-44d6-bb57-8651cf488b78 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:45.694686 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-904978d2-4f8b-4fe8-b839-613e563a2926 req-09c6b67a-1d8e-44a0-af9a-46bc597196ee service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:45.694923 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-f5031fd5-c21a-44d6-bb57-8651cf488b78 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd" status: 200 len: 1214 microversion: 2.1 time: 0.094138 Jul 31 18:39:45.695256 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-904978d2-4f8b-4fe8-b839-613e563a2926 req-09c6b67a-1d8e-44a0-af9a-46bc597196ee service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:45.700886 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 193/370] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:45 2022] GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:45.710732 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-904978d2-4f8b-4fe8-b839-613e563a2926 req-09c6b67a-1d8e-44a0-af9a-46bc597196ee service nova] Creating event network-changed:4200cac4-2be0-4499-a408-eff0761571a8 for instance 4377ead1-89c3-4e21-b45c-c20dcf7bacf9 on hv-cinder-84984 Jul 31 18:39:45.711369 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-89f33f09-ba04-46e3-a6a8-1f7b560d485b tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:45.711975 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-89f33f09-ba04-46e3-a6a8-1f7b560d485b tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:45.720558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-89f33f09-ba04-46e3-a6a8-1f7b560d485b tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:45.720899 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-89f33f09-ba04-46e3-a6a8-1f7b560d485b tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:45.721700 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-89f33f09-ba04-46e3-a6a8-1f7b560d485b tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:45.722645 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-89f33f09-ba04-46e3-a6a8-1f7b560d485b tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:45.723715 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-904978d2-4f8b-4fe8-b839-613e563a2926 req-09c6b67a-1d8e-44a0-af9a-46bc597196ee service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043546 Jul 31 18:39:45.724837 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 178/371] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:39:45.897691 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-89f33f09-ba04-46e3-a6a8-1f7b560d485b tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:45.907799 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-89f33f09-ba04-46e3-a6a8-1f7b560d485b tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1710 microversion: 2.1 time: 0.211018 Jul 31 18:39:45.908595 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 194/372] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:45 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1710 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:46.393519 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-bdb5abdc-7780-4780-b109-1acce5c991e5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:46.394285 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-bdb5abdc-7780-4780-b109-1acce5c991e5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:46.401640 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bdb5abdc-7780-4780-b109-1acce5c991e5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:46.402148 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bdb5abdc-7780-4780-b109-1acce5c991e5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:46.403083 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bdb5abdc-7780-4780-b109-1acce5c991e5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:46.404411 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bdb5abdc-7780-4780-b109-1acce5c991e5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:46.545275 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-bdb5abdc-7780-4780-b109-1acce5c991e5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:46.553966 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-bdb5abdc-7780-4780-b109-1acce5c991e5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:46.555560 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-bdb5abdc-7780-4780-b109-1acce5c991e5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:46.556826 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-bdb5abdc-7780-4780-b109-1acce5c991e5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1721 microversion: 2.20 time: 0.167820 Jul 31 18:39:46.557458 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 179/373] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:46 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:46.716241 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-cd983d7f-ef25-49ec-bb50-c554450eb7cf tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:46.717215 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-cd983d7f-ef25-49ec-bb50-c554450eb7cf tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:46.724318 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cd983d7f-ef25-49ec-bb50-c554450eb7cf tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:46.724914 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cd983d7f-ef25-49ec-bb50-c554450eb7cf tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:46.725574 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cd983d7f-ef25-49ec-bb50-c554450eb7cf tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:46.726003 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cd983d7f-ef25-49ec-bb50-c554450eb7cf tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:46.787822 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-cd983d7f-ef25-49ec-bb50-c554450eb7cf tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:46.795479 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-cd983d7f-ef25-49ec-bb50-c554450eb7cf tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd" status: 200 len: 1218 microversion: 2.1 time: 0.083844 Jul 31 18:39:46.796056 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 195/374] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:46 2022] GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:46.933302 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-60dd8f02-e433-48f7-9d26-11ad2492c804 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:46.934323 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-60dd8f02-e433-48f7-9d26-11ad2492c804 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:46.944731 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-60dd8f02-e433-48f7-9d26-11ad2492c804 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:46.945527 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-60dd8f02-e433-48f7-9d26-11ad2492c804 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:46.946797 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-60dd8f02-e433-48f7-9d26-11ad2492c804 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:46.947521 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-60dd8f02-e433-48f7-9d26-11ad2492c804 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:47.095808 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-60dd8f02-e433-48f7-9d26-11ad2492c804 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:47.104138 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-60dd8f02-e433-48f7-9d26-11ad2492c804 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1710 microversion: 2.1 time: 0.177356 Jul 31 18:39:47.104750 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 180/375] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:46 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1710 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:47.584222 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-14c0e270-a10b-4c35-96f2-a13b481b71e9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:47.585123 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-14c0e270-a10b-4c35-96f2-a13b481b71e9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:47.596201 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-14c0e270-a10b-4c35-96f2-a13b481b71e9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:47.596986 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-14c0e270-a10b-4c35-96f2-a13b481b71e9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:47.598237 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-14c0e270-a10b-4c35-96f2-a13b481b71e9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:47.598987 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-14c0e270-a10b-4c35-96f2-a13b481b71e9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:47.738957 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-14c0e270-a10b-4c35-96f2-a13b481b71e9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:47.748997 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-14c0e270-a10b-4c35-96f2-a13b481b71e9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:47.750557 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-14c0e270-a10b-4c35-96f2-a13b481b71e9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:47.751733 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-14c0e270-a10b-4c35-96f2-a13b481b71e9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1721 microversion: 2.20 time: 0.174218 Jul 31 18:39:47.752290 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 196/376] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:47 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:47.817739 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-d0b673e9-d4cb-4975-85c7-58f8d6312fa8 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:47.818318 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-d0b673e9-d4cb-4975-85c7-58f8d6312fa8 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:47.825719 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d0b673e9-d4cb-4975-85c7-58f8d6312fa8 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:47.826651 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d0b673e9-d4cb-4975-85c7-58f8d6312fa8 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:47.826923 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d0b673e9-d4cb-4975-85c7-58f8d6312fa8 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:47.827359 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d0b673e9-d4cb-4975-85c7-58f8d6312fa8 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:47.896099 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-d0b673e9-d4cb-4975-85c7-58f8d6312fa8 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:47.904944 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-d0b673e9-d4cb-4975-85c7-58f8d6312fa8 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd" status: 200 len: 1210 microversion: 2.1 time: 0.092317 Jul 31 18:39:47.905605 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 181/377] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:47 2022] GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:48.127594 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f7e23267-9225-476a-ac1e-6e4eda03187c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:48.128201 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-f7e23267-9225-476a-ac1e-6e4eda03187c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:48.135352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f7e23267-9225-476a-ac1e-6e4eda03187c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:48.135802 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f7e23267-9225-476a-ac1e-6e4eda03187c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:48.136549 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f7e23267-9225-476a-ac1e-6e4eda03187c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:48.137019 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f7e23267-9225-476a-ac1e-6e4eda03187c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:48.277745 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-f7e23267-9225-476a-ac1e-6e4eda03187c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:48.286375 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-f7e23267-9225-476a-ac1e-6e4eda03187c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1714 microversion: 2.1 time: 0.163286 Jul 31 18:39:48.286957 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 197/378] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:48 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1714 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:48.777751 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-1eaaa6e6-b701-4382-a384-50045a022c90 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:48.778358 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-1eaaa6e6-b701-4382-a384-50045a022c90 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:48.784476 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1eaaa6e6-b701-4382-a384-50045a022c90 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:48.784955 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1eaaa6e6-b701-4382-a384-50045a022c90 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:48.785723 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1eaaa6e6-b701-4382-a384-50045a022c90 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:48.786155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1eaaa6e6-b701-4382-a384-50045a022c90 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:48.926656 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-66922c4e-e27f-4d82-a3dd-00f458ef0ac6 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:48.927420 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-66922c4e-e27f-4d82-a3dd-00f458ef0ac6 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:48.934294 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-66922c4e-e27f-4d82-a3dd-00f458ef0ac6 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:48.934823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-66922c4e-e27f-4d82-a3dd-00f458ef0ac6 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:48.935587 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-66922c4e-e27f-4d82-a3dd-00f458ef0ac6 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:48.936014 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-66922c4e-e27f-4d82-a3dd-00f458ef0ac6 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:49.001541 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-66922c4e-e27f-4d82-a3dd-00f458ef0ac6 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:49.009622 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-66922c4e-e27f-4d82-a3dd-00f458ef0ac6 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd" status: 200 len: 1272 microversion: 2.1 time: 0.087044 Jul 31 18:39:49.010400 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 198/379] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:48 2022] GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd => generated 1272 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:39:49.022226 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-1eaaa6e6-b701-4382-a384-50045a022c90 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:49.030544 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-1eaaa6e6-b701-4382-a384-50045a022c90 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:49.032031 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-1eaaa6e6-b701-4382-a384-50045a022c90 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:49.033237 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-1eaaa6e6-b701-4382-a384-50045a022c90 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1664 microversion: 2.20 time: 0.259419 Jul 31 18:39:49.033792 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 182/380] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:48 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1664 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:49.055645 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-b1961a03-d247-4dae-897d-9905b9678104 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b879bc6-ee76-4dbf-9534-41cfa428d1bc"}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:49.058089 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-b1961a03-d247-4dae-897d-9905b9678104 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:49.064469 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b1961a03-d247-4dae-897d-9905b9678104 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:49.064958 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b1961a03-d247-4dae-897d-9905b9678104 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:49.065707 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b1961a03-d247-4dae-897d-9905b9678104 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:49.066118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b1961a03-d247-4dae-897d-9905b9678104 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:49.137796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:49.358698 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-b1961a03-d247-4dae-897d-9905b9678104 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "POST /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.307145 Jul 31 18:39:49.359344 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 199/381] 10.222.0.49 () {62 vars in 1364 bytes} [Sun Jul 31 18:39:49 2022] POST /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f/os-volume_attachments => generated 188 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 18:39:49.483839 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-5956a60d-27a1-4a75-b23b-634dfc3e01e0 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:49.484469 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-5956a60d-27a1-4a75-b23b-634dfc3e01e0 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:49.491302 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5956a60d-27a1-4a75-b23b-634dfc3e01e0 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:49.493912 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5956a60d-27a1-4a75-b23b-634dfc3e01e0 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:49.494671 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5956a60d-27a1-4a75-b23b-634dfc3e01e0 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:49.495122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5956a60d-27a1-4a75-b23b-634dfc3e01e0 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:49.540304 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-5956a60d-27a1-4a75-b23b-634dfc3e01e0 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124333) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 31 18:39:49.611803 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-5956a60d-27a1-4a75-b23b-634dfc3e01e0 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "POST /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f/action" status: 202 len: 0 microversion: 2.20 time: 0.132035 Jul 31 18:39:49.615637 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 183/382] 10.222.0.49 () {62 vars in 1319 bytes} [Sun Jul 31 18:39:49 2022] POST /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 18:39:49.621006 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-d3e584a1-4996-43a3-94c8-49fdf6319d4a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:49.621611 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-d3e584a1-4996-43a3-94c8-49fdf6319d4a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:49.629436 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d3e584a1-4996-43a3-94c8-49fdf6319d4a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:49.630017 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d3e584a1-4996-43a3-94c8-49fdf6319d4a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:49.631273 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d3e584a1-4996-43a3-94c8-49fdf6319d4a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:49.631402 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d3e584a1-4996-43a3-94c8-49fdf6319d4a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:49.776790 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-d3e584a1-4996-43a3-94c8-49fdf6319d4a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:49.785556 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-d3e584a1-4996-43a3-94c8-49fdf6319d4a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:49.787068 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-d3e584a1-4996-43a3-94c8-49fdf6319d4a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:49.788261 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-d3e584a1-4996-43a3-94c8-49fdf6319d4a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1750 microversion: 2.20 time: 0.171369 Jul 31 18:39:49.788993 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 200/383] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:49 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1750 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:50.030958 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-984b2a00-2922-4bf0-82d7-92c7e71fa24a tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:50.031935 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-984b2a00-2922-4bf0-82d7-92c7e71fa24a tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:50.039209 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-984b2a00-2922-4bf0-82d7-92c7e71fa24a tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:50.039730 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-984b2a00-2922-4bf0-82d7-92c7e71fa24a tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:50.040547 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-984b2a00-2922-4bf0-82d7-92c7e71fa24a tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:50.041067 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-984b2a00-2922-4bf0-82d7-92c7e71fa24a tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:50.262142 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-984b2a00-2922-4bf0-82d7-92c7e71fa24a tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:50.271381 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-984b2a00-2922-4bf0-82d7-92c7e71fa24a tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd" status: 200 len: 1314 microversion: 2.1 time: 0.244274 Jul 31 18:39:50.272651 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 184/384] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:50 2022] GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:50.369829 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-e582970d-b1b0-4594-8524-9c8e8c194606 req-00f08c54-8ee1-4b49-8a5e-7edfb19eda40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5685ff7f-0248-4692-a8f1-da932e8a59bd", "tag": "24925559-70a4-43b8-9bfc-bebfce530e05"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:50.384832 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-e582970d-b1b0-4594-8524-9c8e8c194606 req-00f08c54-8ee1-4b49-8a5e-7edfb19eda40 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:50.385450 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-e582970d-b1b0-4594-8524-9c8e8c194606 req-00f08c54-8ee1-4b49-8a5e-7edfb19eda40 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:50.400306 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-e582970d-b1b0-4594-8524-9c8e8c194606 req-00f08c54-8ee1-4b49-8a5e-7edfb19eda40 service nova] Creating event network-changed:24925559-70a4-43b8-9bfc-bebfce530e05 for instance 5685ff7f-0248-4692-a8f1-da932e8a59bd on hv-cinder-84984 Jul 31 18:39:50.405200 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-e582970d-b1b0-4594-8524-9c8e8c194606 req-00f08c54-8ee1-4b49-8a5e-7edfb19eda40 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039136 Jul 31 18:39:50.406042 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 201/385] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:39:50.812375 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-0b642746-8ea5-4be9-a642-7524f93e74bd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:50.813127 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-0b642746-8ea5-4be9-a642-7524f93e74bd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:50.819612 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0b642746-8ea5-4be9-a642-7524f93e74bd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:50.820045 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0b642746-8ea5-4be9-a642-7524f93e74bd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:50.820837 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0b642746-8ea5-4be9-a642-7524f93e74bd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:50.821272 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0b642746-8ea5-4be9-a642-7524f93e74bd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:50.956063 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-0b642746-8ea5-4be9-a642-7524f93e74bd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:50.964882 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-0b642746-8ea5-4be9-a642-7524f93e74bd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:50.966496 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-0b642746-8ea5-4be9-a642-7524f93e74bd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:50.967654 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-0b642746-8ea5-4be9-a642-7524f93e74bd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1752 microversion: 2.20 time: 0.159724 Jul 31 18:39:50.968214 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 185/386] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:50 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 18:39:51.297660 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-fdd97326-8f87-48c0-83a5-5f8afaf5e5ee tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:51.298795 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-fdd97326-8f87-48c0-83a5-5f8afaf5e5ee tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:51.309433 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fdd97326-8f87-48c0-83a5-5f8afaf5e5ee tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:51.310169 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fdd97326-8f87-48c0-83a5-5f8afaf5e5ee tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:51.311411 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fdd97326-8f87-48c0-83a5-5f8afaf5e5ee tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:51.312119 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fdd97326-8f87-48c0-83a5-5f8afaf5e5ee tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:51.452394 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-fdd97326-8f87-48c0-83a5-5f8afaf5e5ee tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:51.460013 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-fdd97326-8f87-48c0-83a5-5f8afaf5e5ee tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd" status: 200 len: 1314 microversion: 2.1 time: 0.169514 Jul 31 18:39:51.460577 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 202/387] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:51 2022] GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:51.990672 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-744f24ca-2ebc-4491-b7f2-fce84df6a12f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:51.991262 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-744f24ca-2ebc-4491-b7f2-fce84df6a12f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:51.999472 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-744f24ca-2ebc-4491-b7f2-fce84df6a12f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:51.999920 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-744f24ca-2ebc-4491-b7f2-fce84df6a12f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:52.000789 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-744f24ca-2ebc-4491-b7f2-fce84df6a12f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:52.001145 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-744f24ca-2ebc-4491-b7f2-fce84df6a12f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:52.022041 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:52.195787 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-744f24ca-2ebc-4491-b7f2-fce84df6a12f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:52.205025 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-744f24ca-2ebc-4491-b7f2-fce84df6a12f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:52.206508 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-744f24ca-2ebc-4491-b7f2-fce84df6a12f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:52.207676 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-744f24ca-2ebc-4491-b7f2-fce84df6a12f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1752 microversion: 2.20 time: 0.220986 Jul 31 18:39:52.208233 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 186/388] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:51 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1752 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:52.481525 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-9bd9a976-e5a4-4ac4-ad31-14c48c60e166 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:52.482138 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-9bd9a976-e5a4-4ac4-ad31-14c48c60e166 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:52.489396 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9bd9a976-e5a4-4ac4-ad31-14c48c60e166 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:52.489852 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9bd9a976-e5a4-4ac4-ad31-14c48c60e166 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:52.490629 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9bd9a976-e5a4-4ac4-ad31-14c48c60e166 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:52.491048 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9bd9a976-e5a4-4ac4-ad31-14c48c60e166 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:52.625462 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-9bd9a976-e5a4-4ac4-ad31-14c48c60e166 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:52.633972 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-9bd9a976-e5a4-4ac4-ad31-14c48c60e166 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd" status: 200 len: 1314 microversion: 2.1 time: 0.156337 Jul 31 18:39:52.634548 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 203/389] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:52 2022] GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:53.234118 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-ce6a23bd-8701-48f3-a4be-17268ce22443 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:53.234800 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-ce6a23bd-8701-48f3-a4be-17268ce22443 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:53.241831 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ce6a23bd-8701-48f3-a4be-17268ce22443 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:53.242289 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ce6a23bd-8701-48f3-a4be-17268ce22443 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:53.243113 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ce6a23bd-8701-48f3-a4be-17268ce22443 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:53.243545 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ce6a23bd-8701-48f3-a4be-17268ce22443 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:53.655002 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-ec6ae63c-2f9b-4401-b601-b5610363dfc1 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:53.655569 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-ec6ae63c-2f9b-4401-b601-b5610363dfc1 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:53.662571 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ec6ae63c-2f9b-4401-b601-b5610363dfc1 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:53.662935 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ec6ae63c-2f9b-4401-b601-b5610363dfc1 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:53.663663 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ec6ae63c-2f9b-4401-b601-b5610363dfc1 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:53.664251 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ec6ae63c-2f9b-4401-b601-b5610363dfc1 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:53.685818 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-ce6a23bd-8701-48f3-a4be-17268ce22443 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:53.695241 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-ce6a23bd-8701-48f3-a4be-17268ce22443 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:53.696683 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-ce6a23bd-8701-48f3-a4be-17268ce22443 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:53.697606 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-ce6a23bd-8701-48f3-a4be-17268ce22443 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1808 microversion: 2.20 time: 0.467465 Jul 31 18:39:53.707933 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 187/390] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:53 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1808 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:53.810639 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-ec6ae63c-2f9b-4401-b601-b5610363dfc1 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:53.818369 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-ec6ae63c-2f9b-4401-b601-b5610363dfc1 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd" status: 200 len: 1314 microversion: 2.1 time: 0.167240 Jul 31 18:39:53.818938 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 204/391] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:53 2022] GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:54.729313 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-24ea6e94-06c7-430c-89a5-7e88036a87c3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:54.730074 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-24ea6e94-06c7-430c-89a5-7e88036a87c3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:54.737610 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-24ea6e94-06c7-430c-89a5-7e88036a87c3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:54.738056 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-24ea6e94-06c7-430c-89a5-7e88036a87c3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:54.738839 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-24ea6e94-06c7-430c-89a5-7e88036a87c3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:54.739278 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-24ea6e94-06c7-430c-89a5-7e88036a87c3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:54.840075 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-39b9d4be-64f9-4e60-a712-011f88faee4c tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:54.840901 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-39b9d4be-64f9-4e60-a712-011f88faee4c tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:54.848540 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-39b9d4be-64f9-4e60-a712-011f88faee4c tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:54.849606 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-39b9d4be-64f9-4e60-a712-011f88faee4c tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:54.850420 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-39b9d4be-64f9-4e60-a712-011f88faee4c tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:54.851013 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-39b9d4be-64f9-4e60-a712-011f88faee4c tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:54.905134 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-24ea6e94-06c7-430c-89a5-7e88036a87c3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:54.918355 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-24ea6e94-06c7-430c-89a5-7e88036a87c3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:54.920201 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-24ea6e94-06c7-430c-89a5-7e88036a87c3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:54.921705 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-24ea6e94-06c7-430c-89a5-7e88036a87c3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1808 microversion: 2.20 time: 0.196375 Jul 31 18:39:54.938676 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 188/392] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:54 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:55.006233 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-39b9d4be-64f9-4e60-a712-011f88faee4c tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:55.013759 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-39b9d4be-64f9-4e60-a712-011f88faee4c tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd" status: 200 len: 1314 microversion: 2.1 time: 0.178472 Jul 31 18:39:55.014292 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 205/393] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:54 2022] GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:55.615674 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-c013607f-aafc-4880-8977-6664b5487bf0 req-a761bf66-f28c-4873-84bd-357455de5f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5685ff7f-0248-4692-a8f1-da932e8a59bd", "name": "network-vif-plugged", "status": "completed", "tag": "24925559-70a4-43b8-9bfc-bebfce530e05"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:39:55.629851 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-c013607f-aafc-4880-8977-6664b5487bf0 req-a761bf66-f28c-4873-84bd-357455de5f51 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:55.630977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-c013607f-aafc-4880-8977-6664b5487bf0 req-a761bf66-f28c-4873-84bd-357455de5f51 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:55.644140 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-c013607f-aafc-4880-8977-6664b5487bf0 req-a761bf66-f28c-4873-84bd-357455de5f51 service nova] Creating event network-vif-plugged:24925559-70a4-43b8-9bfc-bebfce530e05 for instance 5685ff7f-0248-4692-a8f1-da932e8a59bd on hv-cinder-84984 Jul 31 18:39:55.649443 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-c013607f-aafc-4880-8977-6664b5487bf0 req-a761bf66-f28c-4873-84bd-357455de5f51 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038054 Jul 31 18:39:55.650134 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 189/394] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:39:55.946248 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-42ae9fbb-eac6-4f9a-9f04-6795864a9850 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:55.947624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-42ae9fbb-eac6-4f9a-9f04-6795864a9850 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:55.950671 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell0:SELECT=2 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:55.951434 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell0:SELECT=8 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:55.958711 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-42ae9fbb-eac6-4f9a-9f04-6795864a9850 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:55.959161 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-42ae9fbb-eac6-4f9a-9f04-6795864a9850 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:55.959933 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-42ae9fbb-eac6-4f9a-9f04-6795864a9850 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:55.960361 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-42ae9fbb-eac6-4f9a-9f04-6795864a9850 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:56.037344 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-cb336a48-e1c3-49f3-b274-d703f2ee3e5d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:56.038667 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-cb336a48-e1c3-49f3-b274-d703f2ee3e5d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:56.045894 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cb336a48-e1c3-49f3-b274-d703f2ee3e5d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:56.046888 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cb336a48-e1c3-49f3-b274-d703f2ee3e5d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:56.048613 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cb336a48-e1c3-49f3-b274-d703f2ee3e5d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:56.049171 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cb336a48-e1c3-49f3-b274-d703f2ee3e5d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:56.130180 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-42ae9fbb-eac6-4f9a-9f04-6795864a9850 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:56.141981 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-42ae9fbb-eac6-4f9a-9f04-6795864a9850 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:56.144384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-42ae9fbb-eac6-4f9a-9f04-6795864a9850 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:56.145827 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-42ae9fbb-eac6-4f9a-9f04-6795864a9850 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1808 microversion: 2.20 time: 0.203578 Jul 31 18:39:56.146465 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 206/395] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:55 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:56.207030 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-cb336a48-e1c3-49f3-b274-d703f2ee3e5d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:56.221004 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-cb336a48-e1c3-49f3-b274-d703f2ee3e5d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd" status: 200 len: 1314 microversion: 2.1 time: 0.188214 Jul 31 18:39:56.221714 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 190/396] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:56 2022] GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:39:57.169069 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-5df28d7a-4826-42cf-846f-1cf5dcf80b73 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:57.169921 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-5df28d7a-4826-42cf-846f-1cf5dcf80b73 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:57.176577 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5df28d7a-4826-42cf-846f-1cf5dcf80b73 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:57.177135 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5df28d7a-4826-42cf-846f-1cf5dcf80b73 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:57.177968 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5df28d7a-4826-42cf-846f-1cf5dcf80b73 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:57.178460 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5df28d7a-4826-42cf-846f-1cf5dcf80b73 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:57.241528 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-d297f9ac-6221-4f0b-9edf-aa16a10797a6 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:57.242213 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-d297f9ac-6221-4f0b-9edf-aa16a10797a6 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:57.249085 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d297f9ac-6221-4f0b-9edf-aa16a10797a6 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:57.249601 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d297f9ac-6221-4f0b-9edf-aa16a10797a6 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:57.250442 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d297f9ac-6221-4f0b-9edf-aa16a10797a6 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:57.250930 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d297f9ac-6221-4f0b-9edf-aa16a10797a6 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:57.313620 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-5df28d7a-4826-42cf-846f-1cf5dcf80b73 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:57.323072 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-5df28d7a-4826-42cf-846f-1cf5dcf80b73 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:57.324751 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-5df28d7a-4826-42cf-846f-1cf5dcf80b73 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:57.326244 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-5df28d7a-4826-42cf-846f-1cf5dcf80b73 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1808 microversion: 2.20 time: 0.161209 Jul 31 18:39:57.326934 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 207/397] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:57 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:57.408713 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-d297f9ac-6221-4f0b-9edf-aa16a10797a6 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:57.416433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-d297f9ac-6221-4f0b-9edf-aa16a10797a6 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd" status: 200 len: 1314 microversion: 2.1 time: 0.178750 Jul 31 18:39:57.417285 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 191/398] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:57 2022] GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:39:58.351081 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-fcbd4194-38a2-4bd3-97b8-8ae64eaeb065 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:58.352436 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-fcbd4194-38a2-4bd3-97b8-8ae64eaeb065 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:58.354951 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:58.362301 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fcbd4194-38a2-4bd3-97b8-8ae64eaeb065 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:58.362712 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fcbd4194-38a2-4bd3-97b8-8ae64eaeb065 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:58.363872 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fcbd4194-38a2-4bd3-97b8-8ae64eaeb065 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:58.364492 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fcbd4194-38a2-4bd3-97b8-8ae64eaeb065 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:58.438223 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-a9716bc0-c154-4e88-a56e-c6190720e2df tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:58.439686 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-a9716bc0-c154-4e88-a56e-c6190720e2df tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:58.447120 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a9716bc0-c154-4e88-a56e-c6190720e2df tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:58.447643 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a9716bc0-c154-4e88-a56e-c6190720e2df tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:58.449229 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a9716bc0-c154-4e88-a56e-c6190720e2df tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:58.449997 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a9716bc0-c154-4e88-a56e-c6190720e2df tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:58.511282 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-fcbd4194-38a2-4bd3-97b8-8ae64eaeb065 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:58.520565 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-fcbd4194-38a2-4bd3-97b8-8ae64eaeb065 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:58.522345 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-fcbd4194-38a2-4bd3-97b8-8ae64eaeb065 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:58.523393 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-fcbd4194-38a2-4bd3-97b8-8ae64eaeb065 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1808 microversion: 2.20 time: 0.176791 Jul 31 18:39:58.533251 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 208/399] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:58 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:39:58.615570 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-a9716bc0-c154-4e88-a56e-c6190720e2df tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:58.623320 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-a9716bc0-c154-4e88-a56e-c6190720e2df tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd" status: 200 len: 1314 microversion: 2.1 time: 0.189923 Jul 31 18:39:58.623887 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 192/400] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:58 2022] GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:39:59.547379 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-40e9828c-3166-4a14-a1ae-6d6fadede336 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:59.548006 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-40e9828c-3166-4a14-a1ae-6d6fadede336 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:59.554648 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-40e9828c-3166-4a14-a1ae-6d6fadede336 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:59.555089 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-40e9828c-3166-4a14-a1ae-6d6fadede336 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:59.555846 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-40e9828c-3166-4a14-a1ae-6d6fadede336 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:59.556271 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-40e9828c-3166-4a14-a1ae-6d6fadede336 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:59.644799 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-6f0df501-6de0-48f0-a60f-eef7f6051b4a tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:39:59.645489 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-6f0df501-6de0-48f0-a60f-eef7f6051b4a tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:39:59.649142 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:39:59.653229 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6f0df501-6de0-48f0-a60f-eef7f6051b4a tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:59.653794 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6f0df501-6de0-48f0-a60f-eef7f6051b4a tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:59.654642 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6f0df501-6de0-48f0-a60f-eef7f6051b4a tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:39:59.655127 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6f0df501-6de0-48f0-a60f-eef7f6051b4a tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:39:59.691465 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-40e9828c-3166-4a14-a1ae-6d6fadede336 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:59.719663 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-40e9828c-3166-4a14-a1ae-6d6fadede336 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:59.721262 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-40e9828c-3166-4a14-a1ae-6d6fadede336 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:59.722424 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-40e9828c-3166-4a14-a1ae-6d6fadede336 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1808 microversion: 2.20 time: 0.179241 Jul 31 18:39:59.723179 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 209/401] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:39:59 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 18:39:59.808856 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-6f0df501-6de0-48f0-a60f-eef7f6051b4a tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:39:59.817853 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-6f0df501-6de0-48f0-a60f-eef7f6051b4a tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd" status: 200 len: 1314 microversion: 2.1 time: 0.176716 Jul 31 18:39:59.819343 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 193/402] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:39:59 2022] GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:40:00.745641 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-764b9587-eba2-4979-a7ee-d1a94ac730ab tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:00.746299 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-764b9587-eba2-4979-a7ee-d1a94ac730ab tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:00.753158 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-764b9587-eba2-4979-a7ee-d1a94ac730ab tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:00.753945 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-764b9587-eba2-4979-a7ee-d1a94ac730ab tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:00.754905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-764b9587-eba2-4979-a7ee-d1a94ac730ab tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:00.755488 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-764b9587-eba2-4979-a7ee-d1a94ac730ab tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:00.843566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-650ab220-6998-4051-b282-8e95fd011c68 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:00.844190 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-650ab220-6998-4051-b282-8e95fd011c68 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:00.853709 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-650ab220-6998-4051-b282-8e95fd011c68 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:00.854153 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-650ab220-6998-4051-b282-8e95fd011c68 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:00.854927 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-650ab220-6998-4051-b282-8e95fd011c68 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:00.855379 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-650ab220-6998-4051-b282-8e95fd011c68 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:00.895859 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-764b9587-eba2-4979-a7ee-d1a94ac730ab tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:00.905641 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-764b9587-eba2-4979-a7ee-d1a94ac730ab tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:00.907242 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-764b9587-eba2-4979-a7ee-d1a94ac730ab tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:00.908532 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-764b9587-eba2-4979-a7ee-d1a94ac730ab tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1808 microversion: 2.20 time: 0.166926 Jul 31 18:40:00.924092 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 210/403] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:40:00 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:40:00.991468 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-650ab220-6998-4051-b282-8e95fd011c68 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:00.999929 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-650ab220-6998-4051-b282-8e95fd011c68 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd" status: 200 len: 1314 microversion: 2.1 time: 0.160417 Jul 31 18:40:01.000518 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 194/404] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:00 2022] GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:01.931909 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-527a3de7-f23a-42d3-803d-62b808808ae9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:01.932564 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-527a3de7-f23a-42d3-803d-62b808808ae9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:01.939596 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-527a3de7-f23a-42d3-803d-62b808808ae9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:01.940062 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-527a3de7-f23a-42d3-803d-62b808808ae9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:01.940860 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-527a3de7-f23a-42d3-803d-62b808808ae9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:01.941294 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-527a3de7-f23a-42d3-803d-62b808808ae9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:02.022771 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-be844daa-b9cd-450f-b8a9-5ac2087485d4 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:02.023773 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-be844daa-b9cd-450f-b8a9-5ac2087485d4 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:02.030578 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-be844daa-b9cd-450f-b8a9-5ac2087485d4 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:02.031214 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-be844daa-b9cd-450f-b8a9-5ac2087485d4 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:02.032507 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-be844daa-b9cd-450f-b8a9-5ac2087485d4 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:02.033157 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-be844daa-b9cd-450f-b8a9-5ac2087485d4 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:02.083285 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-527a3de7-f23a-42d3-803d-62b808808ae9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:02.091885 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-527a3de7-f23a-42d3-803d-62b808808ae9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:02.094602 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-527a3de7-f23a-42d3-803d-62b808808ae9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:02.096072 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-527a3de7-f23a-42d3-803d-62b808808ae9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1808 microversion: 2.20 time: 0.168236 Jul 31 18:40:02.097423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 211/405] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:40:01 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:40:02.171489 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-be844daa-b9cd-450f-b8a9-5ac2087485d4 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:02.179410 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-be844daa-b9cd-450f-b8a9-5ac2087485d4 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd" status: 200 len: 1314 microversion: 2.1 time: 0.162287 Jul 31 18:40:02.180659 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 195/406] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:02 2022] GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:40:03.119968 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-ed57cb61-4e4b-4198-bda5-3a0de0d32d0d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:03.120612 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-ed57cb61-4e4b-4198-bda5-3a0de0d32d0d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:03.127628 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ed57cb61-4e4b-4198-bda5-3a0de0d32d0d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:03.128094 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ed57cb61-4e4b-4198-bda5-3a0de0d32d0d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:03.129288 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ed57cb61-4e4b-4198-bda5-3a0de0d32d0d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:03.129956 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ed57cb61-4e4b-4198-bda5-3a0de0d32d0d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:03.200796 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-c13f8954-408b-45f8-9175-dfd1174c4ca3 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:03.201463 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-c13f8954-408b-45f8-9175-dfd1174c4ca3 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:03.208104 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c13f8954-408b-45f8-9175-dfd1174c4ca3 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:03.208543 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c13f8954-408b-45f8-9175-dfd1174c4ca3 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:03.209365 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c13f8954-408b-45f8-9175-dfd1174c4ca3 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:03.209929 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c13f8954-408b-45f8-9175-dfd1174c4ca3 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:03.263974 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-ed57cb61-4e4b-4198-bda5-3a0de0d32d0d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:03.273491 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-ed57cb61-4e4b-4198-bda5-3a0de0d32d0d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:03.274987 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-ed57cb61-4e4b-4198-bda5-3a0de0d32d0d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:03.276180 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-ed57cb61-4e4b-4198-bda5-3a0de0d32d0d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1808 microversion: 2.20 time: 0.160213 Jul 31 18:40:03.277267 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 212/407] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:40:03 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:40:03.360315 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-c13f8954-408b-45f8-9175-dfd1174c4ca3 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:03.368861 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-c13f8954-408b-45f8-9175-dfd1174c4ca3 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd" status: 200 len: 1314 microversion: 2.1 time: 0.171888 Jul 31 18:40:03.370165 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 196/408] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:03 2022] GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:40:04.303461 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-dfb727fe-804e-470f-a10e-a4b5057f1de1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:04.305007 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-dfb727fe-804e-470f-a10e-a4b5057f1de1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:04.314524 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-dfb727fe-804e-470f-a10e-a4b5057f1de1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:04.315151 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-dfb727fe-804e-470f-a10e-a4b5057f1de1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:04.316353 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-dfb727fe-804e-470f-a10e-a4b5057f1de1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:04.316961 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-dfb727fe-804e-470f-a10e-a4b5057f1de1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:04.390809 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-cc4aad03-0f85-4b97-b88e-21a4b08c193d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:04.391700 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-cc4aad03-0f85-4b97-b88e-21a4b08c193d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:04.399977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cc4aad03-0f85-4b97-b88e-21a4b08c193d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:04.400692 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cc4aad03-0f85-4b97-b88e-21a4b08c193d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:04.401751 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cc4aad03-0f85-4b97-b88e-21a4b08c193d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:04.402292 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cc4aad03-0f85-4b97-b88e-21a4b08c193d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:04.458558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-dfb727fe-804e-470f-a10e-a4b5057f1de1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:04.467761 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-dfb727fe-804e-470f-a10e-a4b5057f1de1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:04.469370 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-dfb727fe-804e-470f-a10e-a4b5057f1de1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:04.470533 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-dfb727fe-804e-470f-a10e-a4b5057f1de1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1808 microversion: 2.20 time: 0.173619 Jul 31 18:40:04.471103 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 213/409] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:40:04 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:40:04.530518 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-cc4aad03-0f85-4b97-b88e-21a4b08c193d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:04.538415 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-cc4aad03-0f85-4b97-b88e-21a4b08c193d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd" status: 200 len: 1314 microversion: 2.1 time: 0.151793 Jul 31 18:40:04.538982 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 197/410] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:04 2022] GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:05.498688 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-1b82fc2e-96c4-42fb-a93e-366b322cf46b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:05.499602 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-1b82fc2e-96c4-42fb-a93e-366b322cf46b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:05.511267 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1b82fc2e-96c4-42fb-a93e-366b322cf46b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:05.512001 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1b82fc2e-96c4-42fb-a93e-366b322cf46b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:05.513333 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1b82fc2e-96c4-42fb-a93e-366b322cf46b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:05.514053 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1b82fc2e-96c4-42fb-a93e-366b322cf46b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:05.529528 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:40:05.558776 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-6b919f3d-96dc-47da-a7ce-c61703618a1f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:05.559368 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-6b919f3d-96dc-47da-a7ce-c61703618a1f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:05.566089 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6b919f3d-96dc-47da-a7ce-c61703618a1f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:05.566534 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6b919f3d-96dc-47da-a7ce-c61703618a1f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:05.567301 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6b919f3d-96dc-47da-a7ce-c61703618a1f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:05.567728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6b919f3d-96dc-47da-a7ce-c61703618a1f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:05.646506 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-1b82fc2e-96c4-42fb-a93e-366b322cf46b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:05.655270 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-1b82fc2e-96c4-42fb-a93e-366b322cf46b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:05.656786 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-1b82fc2e-96c4-42fb-a93e-366b322cf46b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:05.657962 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-1b82fc2e-96c4-42fb-a93e-366b322cf46b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1808 microversion: 2.20 time: 0.166219 Jul 31 18:40:05.658717 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 214/411] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:40:05 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:40:05.752204 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-6b919f3d-96dc-47da-a7ce-c61703618a1f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:05.760219 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-6b919f3d-96dc-47da-a7ce-c61703618a1f tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd" status: 200 len: 1314 microversion: 2.1 time: 0.205297 Jul 31 18:40:05.760797 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 198/412] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:05 2022] GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:06.685680 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-8bc9d701-207a-48d9-984b-177598b1e8f2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:06.686682 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-8bc9d701-207a-48d9-984b-177598b1e8f2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:06.694020 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8bc9d701-207a-48d9-984b-177598b1e8f2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:06.694503 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8bc9d701-207a-48d9-984b-177598b1e8f2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:06.695266 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8bc9d701-207a-48d9-984b-177598b1e8f2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:06.695699 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8bc9d701-207a-48d9-984b-177598b1e8f2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:06.781392 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-520de45f-cb83-49fa-b45f-0225f152e1fe tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:06.781965 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-520de45f-cb83-49fa-b45f-0225f152e1fe tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:06.788917 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-520de45f-cb83-49fa-b45f-0225f152e1fe tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:06.789383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-520de45f-cb83-49fa-b45f-0225f152e1fe tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:06.790144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-520de45f-cb83-49fa-b45f-0225f152e1fe tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:06.790568 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-520de45f-cb83-49fa-b45f-0225f152e1fe tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:06.824180 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-8bc9d701-207a-48d9-984b-177598b1e8f2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:06.832749 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-8bc9d701-207a-48d9-984b-177598b1e8f2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:06.834316 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-8bc9d701-207a-48d9-984b-177598b1e8f2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:06.835483 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-8bc9d701-207a-48d9-984b-177598b1e8f2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1808 microversion: 2.20 time: 0.156486 Jul 31 18:40:06.836045 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 215/413] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:40:06 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:40:06.933635 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-520de45f-cb83-49fa-b45f-0225f152e1fe tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:06.944877 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-520de45f-cb83-49fa-b45f-0225f152e1fe tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd" status: 200 len: 1314 microversion: 2.1 time: 0.167221 Jul 31 18:40:06.945705 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 199/414] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:06 2022] GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:07.861725 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-6cc145de-9c3b-4373-8e8c-6beda4a2a042 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:07.862345 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-6cc145de-9c3b-4373-8e8c-6beda4a2a042 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:07.869075 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6cc145de-9c3b-4373-8e8c-6beda4a2a042 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:07.869522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6cc145de-9c3b-4373-8e8c-6beda4a2a042 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:07.870284 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6cc145de-9c3b-4373-8e8c-6beda4a2a042 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:07.870711 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6cc145de-9c3b-4373-8e8c-6beda4a2a042 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:07.968508 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-60cf376c-635a-4c18-a661-d74e16bcc4f7 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:07.969078 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-60cf376c-635a-4c18-a661-d74e16bcc4f7 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:07.976195 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-60cf376c-635a-4c18-a661-d74e16bcc4f7 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:07.976621 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-60cf376c-635a-4c18-a661-d74e16bcc4f7 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:07.977432 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-60cf376c-635a-4c18-a661-d74e16bcc4f7 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:07.977861 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-60cf376c-635a-4c18-a661-d74e16bcc4f7 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:08.011203 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-6cc145de-9c3b-4373-8e8c-6beda4a2a042 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:08.020005 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-6cc145de-9c3b-4373-8e8c-6beda4a2a042 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:08.021616 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-6cc145de-9c3b-4373-8e8c-6beda4a2a042 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:08.022762 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-6cc145de-9c3b-4373-8e8c-6beda4a2a042 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1808 microversion: 2.20 time: 0.166796 Jul 31 18:40:08.023355 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 216/415] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:40:07 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:40:08.114975 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-60cf376c-635a-4c18-a661-d74e16bcc4f7 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:08.122787 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-60cf376c-635a-4c18-a661-d74e16bcc4f7 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd" status: 200 len: 1496 microversion: 2.1 time: 0.158162 Jul 31 18:40:08.123352 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 200/416] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:07 2022] GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd => generated 1496 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:08.693109 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-d8d5ea65-abfe-4fd8-ab16-cf55e7604605 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:08.693607 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-d8d5ea65-abfe-4fd8-ab16-cf55e7604605 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:08.700335 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d8d5ea65-abfe-4fd8-ab16-cf55e7604605 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:08.700794 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d8d5ea65-abfe-4fd8-ab16-cf55e7604605 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:08.701583 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d8d5ea65-abfe-4fd8-ab16-cf55e7604605 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:08.702016 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d8d5ea65-abfe-4fd8-ab16-cf55e7604605 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:08.729664 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-d8d5ea65-abfe-4fd8-ab16-cf55e7604605 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Going to try to terminate instance {{(pid=124334) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 18:40:08.808528 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-d8d5ea65-abfe-4fd8-ab16-cf55e7604605 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd" status: 204 len: 0 microversion: 2.1 time: 0.119067 Jul 31 18:40:08.809324 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 217/417] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:40:08 2022] DELETE /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 18:40:08.817689 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-6ae3e451-e3fd-491c-82a7-475419ebc98b tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:08.818296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-6ae3e451-e3fd-491c-82a7-475419ebc98b tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:08.824654 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6ae3e451-e3fd-491c-82a7-475419ebc98b tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:08.825132 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6ae3e451-e3fd-491c-82a7-475419ebc98b tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:08.825891 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6ae3e451-e3fd-491c-82a7-475419ebc98b tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:08.826330 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6ae3e451-e3fd-491c-82a7-475419ebc98b tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:08.953939 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-6ae3e451-e3fd-491c-82a7-475419ebc98b tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:08.961953 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-6ae3e451-e3fd-491c-82a7-475419ebc98b tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd" status: 200 len: 1502 microversion: 2.1 time: 0.148350 Jul 31 18:40:08.962517 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 201/418] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:08 2022] GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:09.051007 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-85d5cb72-a4d8-4fac-8631-bd78f38dc5eb tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:09.052151 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-85d5cb72-a4d8-4fac-8631-bd78f38dc5eb tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:09.063135 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-85d5cb72-a4d8-4fac-8631-bd78f38dc5eb tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:09.064018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-85d5cb72-a4d8-4fac-8631-bd78f38dc5eb tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:09.064819 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-85d5cb72-a4d8-4fac-8631-bd78f38dc5eb tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:09.065282 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-85d5cb72-a4d8-4fac-8631-bd78f38dc5eb tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:09.206176 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-85d5cb72-a4d8-4fac-8631-bd78f38dc5eb tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:09.215293 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-85d5cb72-a4d8-4fac-8631-bd78f38dc5eb tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:09.216782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-85d5cb72-a4d8-4fac-8631-bd78f38dc5eb tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:09.217969 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-85d5cb72-a4d8-4fac-8631-bd78f38dc5eb tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1808 microversion: 2.20 time: 0.174298 Jul 31 18:40:09.218525 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 218/419] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:40:09 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:40:09.987263 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-9abea3fc-7c05-4af7-acc9-9e9cd6d17216 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:09.988058 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-9abea3fc-7c05-4af7-acc9-9e9cd6d17216 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:09.997427 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9abea3fc-7c05-4af7-acc9-9e9cd6d17216 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:09.998065 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9abea3fc-7c05-4af7-acc9-9e9cd6d17216 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:09.999857 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9abea3fc-7c05-4af7-acc9-9e9cd6d17216 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:10.000786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9abea3fc-7c05-4af7-acc9-9e9cd6d17216 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:10.143672 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-9abea3fc-7c05-4af7-acc9-9e9cd6d17216 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:10.151533 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-9abea3fc-7c05-4af7-acc9-9e9cd6d17216 tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd" status: 200 len: 1502 microversion: 2.1 time: 0.170775 Jul 31 18:40:10.152103 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 202/420] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:09 2022] GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd => generated 1502 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:10.242191 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-0e93b4aa-52ba-477e-84bb-d8666afe4457 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:10.242816 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-0e93b4aa-52ba-477e-84bb-d8666afe4457 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:10.249960 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0e93b4aa-52ba-477e-84bb-d8666afe4457 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:10.250399 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0e93b4aa-52ba-477e-84bb-d8666afe4457 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:10.251162 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0e93b4aa-52ba-477e-84bb-d8666afe4457 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:10.251593 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0e93b4aa-52ba-477e-84bb-d8666afe4457 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:10.400656 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-0e93b4aa-52ba-477e-84bb-d8666afe4457 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:10.409277 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-0e93b4aa-52ba-477e-84bb-d8666afe4457 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:10.410780 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-0e93b4aa-52ba-477e-84bb-d8666afe4457 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:10.411953 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-0e93b4aa-52ba-477e-84bb-d8666afe4457 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1808 microversion: 2.20 time: 0.173721 Jul 31 18:40:10.412516 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 219/421] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:40:10 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:40:11.172395 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-0a7de979-4ba9-4164-94f3-9f2aec25999d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:11.173018 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-0a7de979-4ba9-4164-94f3-9f2aec25999d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:11.180254 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0a7de979-4ba9-4164-94f3-9f2aec25999d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:11.180729 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0a7de979-4ba9-4164-94f3-9f2aec25999d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:11.181634 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0a7de979-4ba9-4164-94f3-9f2aec25999d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:11.181956 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0a7de979-4ba9-4164-94f3-9f2aec25999d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:11.189135 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-bb1c3fda-3fd6-4f48-95d9-394bcfb87cc1 req-417f2882-1afd-4e9f-95b6-272beecfc8ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5685ff7f-0248-4692-a8f1-da932e8a59bd", "name": "network-vif-deleted", "tag": "24925559-70a4-43b8-9bfc-bebfce530e05"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:40:11.199953 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-bb1c3fda-3fd6-4f48-95d9-394bcfb87cc1 req-417f2882-1afd-4e9f-95b6-272beecfc8ec service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:11.200491 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-bb1c3fda-3fd6-4f48-95d9-394bcfb87cc1 req-417f2882-1afd-4e9f-95b6-272beecfc8ec service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:11.212355 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-bb1c3fda-3fd6-4f48-95d9-394bcfb87cc1 req-417f2882-1afd-4e9f-95b6-272beecfc8ec service nova] Creating event network-vif-deleted:24925559-70a4-43b8-9bfc-bebfce530e05 for instance 5685ff7f-0248-4692-a8f1-da932e8a59bd on hv-cinder-84984 Jul 31 18:40:11.217783 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-bb1c3fda-3fd6-4f48-95d9-394bcfb87cc1 req-417f2882-1afd-4e9f-95b6-272beecfc8ec service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032507 Jul 31 18:40:11.218655 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 220/422] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:40:11.252906 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-0a7de979-4ba9-4164-94f3-9f2aec25999d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:11.255524 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=100 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:40:11.263289 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-0a7de979-4ba9-4164-94f3-9f2aec25999d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd" status: 200 len: 1460 microversion: 2.1 time: 0.094722 Jul 31 18:40:11.263879 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 203/423] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:11 2022] GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd => generated 1460 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:11.440510 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-326db49c-482f-4db8-8729-d9fc7993881d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:11.441564 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-326db49c-482f-4db8-8729-d9fc7993881d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:11.452751 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-326db49c-482f-4db8-8729-d9fc7993881d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:11.453549 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-326db49c-482f-4db8-8729-d9fc7993881d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:11.455257 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-326db49c-482f-4db8-8729-d9fc7993881d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:11.455894 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-326db49c-482f-4db8-8729-d9fc7993881d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:11.598895 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-326db49c-482f-4db8-8729-d9fc7993881d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:11.607970 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-326db49c-482f-4db8-8729-d9fc7993881d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:11.609513 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-326db49c-482f-4db8-8729-d9fc7993881d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:11.610676 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-326db49c-482f-4db8-8729-d9fc7993881d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1808 microversion: 2.20 time: 0.177478 Jul 31 18:40:11.611235 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 221/424] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:40:11 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:40:12.283599 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-8f49d16b-932e-41fa-b849-eb444b7c02ad tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:12.284214 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-8f49d16b-932e-41fa-b849-eb444b7c02ad tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:12.290580 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8f49d16b-932e-41fa-b849-eb444b7c02ad tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:12.290994 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8f49d16b-932e-41fa-b849-eb444b7c02ad tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:12.291753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8f49d16b-932e-41fa-b849-eb444b7c02ad tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:12.292176 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8f49d16b-932e-41fa-b849-eb444b7c02ad tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:12.323408 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8f49d16b-932e-41fa-b849-eb444b7c02ad tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:12.323850 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8f49d16b-932e-41fa-b849-eb444b7c02ad tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:12.324285 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.objects.instance [None req-8f49d16b-932e-41fa-b849-eb444b7c02ad tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lazy-loading 'fault' on Instance uuid 5685ff7f-0248-4692-a8f1-da932e8a59bd {{(pid=124333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:40:12.368080 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-8f49d16b-932e-41fa-b849-eb444b7c02ad tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0a63102acb43158fb074f468ca2faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91867ca69f334c76a3671331612ea954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:12.375093 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-8f49d16b-932e-41fa-b849-eb444b7c02ad tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd" status: 200 len: 1304 microversion: 2.1 time: 0.095358 Jul 31 18:40:12.375646 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 204/425] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:12 2022] GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:12.645321 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-448d35e8-260e-44c7-8999-b370972cf7a4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:12.646299 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-448d35e8-260e-44c7-8999-b370972cf7a4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:12.658111 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-448d35e8-260e-44c7-8999-b370972cf7a4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:12.658818 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-448d35e8-260e-44c7-8999-b370972cf7a4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:12.659588 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-448d35e8-260e-44c7-8999-b370972cf7a4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:12.660025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-448d35e8-260e-44c7-8999-b370972cf7a4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:12.804042 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-448d35e8-260e-44c7-8999-b370972cf7a4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:12.813629 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-448d35e8-260e-44c7-8999-b370972cf7a4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:12.815230 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-448d35e8-260e-44c7-8999-b370972cf7a4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:12.816419 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-448d35e8-260e-44c7-8999-b370972cf7a4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1808 microversion: 2.20 time: 0.177692 Jul 31 18:40:12.817022 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 222/426] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:40:12 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:40:13.400809 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-d9e6bcae-5475-45e2-aa9b-f1cf605a0c8d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:13.401792 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-d9e6bcae-5475-45e2-aa9b-f1cf605a0c8d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] [instance: 5685ff7f-0248-4692-a8f1-da932e8a59bd] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:13.411324 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d9e6bcae-5475-45e2-aa9b-f1cf605a0c8d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:13.411768 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d9e6bcae-5475-45e2-aa9b-f1cf605a0c8d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:13.412563 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d9e6bcae-5475-45e2-aa9b-f1cf605a0c8d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:13.413029 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d9e6bcae-5475-45e2-aa9b-f1cf605a0c8d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:13.426456 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-d9e6bcae-5475-45e2-aa9b-f1cf605a0c8d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] HTTP exception thrown: Instance 5685ff7f-0248-4692-a8f1-da932e8a59bd could not be found. Jul 31 18:40:13.428068 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-d9e6bcae-5475-45e2-aa9b-f1cf605a0c8d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Request method failure captured: Jul 31 18:40:13.428068 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd HTTP/1.1 Jul 31 18:40:13.428068 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:40:13.428068 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:40:13.428068 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:40:13.428068 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:40:13.428068 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:40:13.428068 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:40:13.428068 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:40:13.428068 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:40:13.428068 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5sxbWF-fkBYz2WxYFI5lgetH7DEHdhk9u6IjRa4kU7MxhDySZxBk-s2D0bv2dYibhjfm5AAF8ULEAV5srhBr8qa4WtOHMmR5IdR0m1Yefb4qdaKVyBARWt4njUGokWmuuVxkLQNo6vv_ro43RoLBF05L64ixU22O41-CuDZgnsBlhks Jul 31 18:40:13.428068 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:40:13.428068 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:40:13.428068 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:40:13.428068 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:40:13.428068 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:40:13.428068 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:40:13.428068 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: 91867ca69f334c76a3671331612ea954 Jul 31 18:40:13.428068 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-VolumesActionsTest-1855021462 Jul 31 18:40:13.428068 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:40:13.428068 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:40:13.429531 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/91867ca69f334c76a3671331612ea954"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_91867ca69f334c76a3671331612ea954", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/91867ca69f334c76a3671331612ea954"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/91867ca69f334c76a3671331612ea954"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:40:13.429531 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-VolumesActionsTest-1855021462 Jul 31 18:40:13.429531 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: 91867ca69f334c76a3671331612ea954 Jul 31 18:40:13.429531 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-VolumesActionsTest-1855021462 Jul 31 18:40:13.429531 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-VolumesActionsTest-1855021462-project Jul 31 18:40:13.429531 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:40:13.429531 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:40:13.429531 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 0e0a63102acb43158fb074f468ca2faf Jul 31 18:40:13.429531 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-VolumesActionsTest-1855021462-project Jul 31 18:40:13.429531 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: > Jul 31 18:40:13.429531 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Instance 5685ff7f-0248-4692-a8f1-da932e8a59bd could not be found. Jul 31 18:40:13.429531 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': '5685ff7f-0248-4692-a8f1-da932e8a59bd'} Jul 31 18:40:13.430460 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:40:13.430460 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:40:13.430460 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:40:13.430460 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:40:13.430460 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:40:13.430460 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:40:13.430460 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:40:13.430460 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:40:13.430460 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:40:13.430460 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:40:13.430460 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5685ff7f-0248-4692-a8f1-da932e8a59bd could not be found. Jul 31 18:40:13.430460 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:40:13.430460 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:40:13.430460 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:40:13.430460 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:40:13.430460 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:40:13.430460 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:40:13.430460 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:40:13.430460 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:40:13.430460 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:40:13.431929 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:40:13.431929 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:40:13.431929 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:40:13.431929 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:40:13.431929 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:40:13.431929 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:40:13.431929 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:40:13.431929 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5685ff7f-0248-4692-a8f1-da932e8a59bd could not be found. Jul 31 18:40:13.431929 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:40:13.431929 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:40:13.431929 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:40:13.431929 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:40:13.431929 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:40:13.431929 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:40:13.431929 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:40:13.431929 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:40:13.431929 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5685ff7f-0248-4692-a8f1-da932e8a59bd could not be found. Jul 31 18:40:13.431929 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:40:13.433441 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-d9e6bcae-5475-45e2-aa9b-f1cf605a0c8d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] Returning 404 to user: Instance 5685ff7f-0248-4692-a8f1-da932e8a59bd could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:40:13.433441 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-d9e6bcae-5475-45e2-aa9b-f1cf605a0c8d tempest-VolumesActionsTest-1855021462 tempest-VolumesActionsTest-1855021462-project] 10.222.0.49 "GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd" status: 404 len: 111 microversion: 2.1 time: 0.035193 Jul 31 18:40:13.433441 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 205/427] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:13 2022] GET /compute/v2.1/servers/5685ff7f-0248-4692-a8f1-da932e8a59bd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:40:13.841803 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-e295c218-83f4-4eed-a643-c5e3c810d427 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:13.842411 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-e295c218-83f4-4eed-a643-c5e3c810d427 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:13.848627 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e295c218-83f4-4eed-a643-c5e3c810d427 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:13.849163 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e295c218-83f4-4eed-a643-c5e3c810d427 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:13.849879 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e295c218-83f4-4eed-a643-c5e3c810d427 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:13.850414 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e295c218-83f4-4eed-a643-c5e3c810d427 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:13.987839 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-e295c218-83f4-4eed-a643-c5e3c810d427 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:13.996294 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-e295c218-83f4-4eed-a643-c5e3c810d427 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:13.998082 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-e295c218-83f4-4eed-a643-c5e3c810d427 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:13.999311 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-e295c218-83f4-4eed-a643-c5e3c810d427 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1808 microversion: 2.20 time: 0.163754 Jul 31 18:40:13.999890 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 223/428] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:40:13 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:40:15.028329 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-26714237-bc1e-40fa-a9b4-66b077802c7c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:15.030432 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-26714237-bc1e-40fa-a9b4-66b077802c7c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:15.038352 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-26714237-bc1e-40fa-a9b4-66b077802c7c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:15.038805 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-26714237-bc1e-40fa-a9b4-66b077802c7c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:15.039571 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-26714237-bc1e-40fa-a9b4-66b077802c7c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:15.040003 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-26714237-bc1e-40fa-a9b4-66b077802c7c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:15.190888 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-26714237-bc1e-40fa-a9b4-66b077802c7c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:15.204553 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-26714237-bc1e-40fa-a9b4-66b077802c7c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:15.206441 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-26714237-bc1e-40fa-a9b4-66b077802c7c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:15.207600 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-26714237-bc1e-40fa-a9b4-66b077802c7c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1808 microversion: 2.20 time: 0.187207 Jul 31 18:40:15.208145 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 206/429] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:40:15 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:40:16.235724 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-397273e9-dd4f-431a-bb29-d104c85ae0bd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:16.236489 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-397273e9-dd4f-431a-bb29-d104c85ae0bd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:16.247689 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-397273e9-dd4f-431a-bb29-d104c85ae0bd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:16.248425 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-397273e9-dd4f-431a-bb29-d104c85ae0bd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:16.249790 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-397273e9-dd4f-431a-bb29-d104c85ae0bd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:16.250415 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-397273e9-dd4f-431a-bb29-d104c85ae0bd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:16.384473 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-397273e9-dd4f-431a-bb29-d104c85ae0bd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:16.393786 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-397273e9-dd4f-431a-bb29-d104c85ae0bd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:16.395295 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-397273e9-dd4f-431a-bb29-d104c85ae0bd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:16.396408 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-397273e9-dd4f-431a-bb29-d104c85ae0bd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1808 microversion: 2.20 time: 0.167992 Jul 31 18:40:16.397029 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 224/430] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:40:16 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:40:17.427111 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-83e0ac5f-a596-4385-b235-cbdfa7822641 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:17.427850 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-83e0ac5f-a596-4385-b235-cbdfa7822641 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:17.436881 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-83e0ac5f-a596-4385-b235-cbdfa7822641 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:17.437476 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-83e0ac5f-a596-4385-b235-cbdfa7822641 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:17.438489 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-83e0ac5f-a596-4385-b235-cbdfa7822641 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:17.439072 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-83e0ac5f-a596-4385-b235-cbdfa7822641 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:17.576424 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-83e0ac5f-a596-4385-b235-cbdfa7822641 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:17.584931 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-83e0ac5f-a596-4385-b235-cbdfa7822641 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:17.586417 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-83e0ac5f-a596-4385-b235-cbdfa7822641 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:17.587584 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-83e0ac5f-a596-4385-b235-cbdfa7822641 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1808 microversion: 2.20 time: 0.166602 Jul 31 18:40:17.588137 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 207/431] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:40:17 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:40:17.846520 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-cca6b439-5e48-4b4a-861a-bc6fb5a8cbf5 req-6597b840-fa15-412f-8239-5ce1bb932918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "432e6c6a-9a11-4f18-8dbe-fbb82e95f39f", "name": "network-vif-plugged", "status": "completed", "tag": "2a079287-92d9-4c25-bdec-babc0efb1738"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:40:17.864568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-cca6b439-5e48-4b4a-861a-bc6fb5a8cbf5 req-6597b840-fa15-412f-8239-5ce1bb932918 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:17.865042 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-cca6b439-5e48-4b4a-861a-bc6fb5a8cbf5 req-6597b840-fa15-412f-8239-5ce1bb932918 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:17.877472 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-cca6b439-5e48-4b4a-861a-bc6fb5a8cbf5 req-6597b840-fa15-412f-8239-5ce1bb932918 service nova] Creating event network-vif-plugged:2a079287-92d9-4c25-bdec-babc0efb1738 for instance 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f on hv-cinder-84984 Jul 31 18:40:17.882863 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-cca6b439-5e48-4b4a-861a-bc6fb5a8cbf5 req-6597b840-fa15-412f-8239-5ce1bb932918 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042541 Jul 31 18:40:17.883465 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 225/432] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:40:18.615258 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-d8d67f36-05d1-45dd-8b08-2e2fb895e91c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:18.616801 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-d8d67f36-05d1-45dd-8b08-2e2fb895e91c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:18.625933 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d8d67f36-05d1-45dd-8b08-2e2fb895e91c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:18.626849 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d8d67f36-05d1-45dd-8b08-2e2fb895e91c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:18.628529 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d8d67f36-05d1-45dd-8b08-2e2fb895e91c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:18.629721 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d8d67f36-05d1-45dd-8b08-2e2fb895e91c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:18.903375 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-d8d67f36-05d1-45dd-8b08-2e2fb895e91c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:18.915558 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-d8d67f36-05d1-45dd-8b08-2e2fb895e91c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:18.917068 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-d8d67f36-05d1-45dd-8b08-2e2fb895e91c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:18.918403 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-d8d67f36-05d1-45dd-8b08-2e2fb895e91c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1808 microversion: 2.20 time: 0.310581 Jul 31 18:40:18.919138 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 208/433] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:40:18 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1808 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:40:19.949692 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-aabe1a76-3d19-4614-8c9d-2e301e3585d6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:19.951325 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-aabe1a76-3d19-4614-8c9d-2e301e3585d6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:19.958654 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-aabe1a76-3d19-4614-8c9d-2e301e3585d6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:19.959573 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-aabe1a76-3d19-4614-8c9d-2e301e3585d6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:19.960887 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-aabe1a76-3d19-4614-8c9d-2e301e3585d6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:19.961620 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-aabe1a76-3d19-4614-8c9d-2e301e3585d6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:20.360609 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-aabe1a76-3d19-4614-8c9d-2e301e3585d6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:20.372376 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-aabe1a76-3d19-4614-8c9d-2e301e3585d6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:20.374508 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-aabe1a76-3d19-4614-8c9d-2e301e3585d6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:20.376053 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-aabe1a76-3d19-4614-8c9d-2e301e3585d6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1808 microversion: 2.20 time: 0.431956 Jul 31 18:40:20.388928 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 226/434] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:40:19 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1808 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:40:21.414357 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-29499dd5-5434-4089-89c6-e4a897f1adf6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:21.414967 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-29499dd5-5434-4089-89c6-e4a897f1adf6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:21.421622 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-29499dd5-5434-4089-89c6-e4a897f1adf6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:21.422205 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-29499dd5-5434-4089-89c6-e4a897f1adf6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:21.422761 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-29499dd5-5434-4089-89c6-e4a897f1adf6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:21.423199 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-29499dd5-5434-4089-89c6-e4a897f1adf6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:21.576602 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-29499dd5-5434-4089-89c6-e4a897f1adf6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:21.591834 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-29499dd5-5434-4089-89c6-e4a897f1adf6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:21.593827 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-29499dd5-5434-4089-89c6-e4a897f1adf6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:21.595029 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-29499dd5-5434-4089-89c6-e4a897f1adf6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1808 microversion: 2.20 time: 0.194562 Jul 31 18:40:21.595785 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 209/435] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:40:21 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 18:40:22.619409 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-619b49e6-7654-4814-8bfb-625ff8739615 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:22.620034 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-619b49e6-7654-4814-8bfb-625ff8739615 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:22.627047 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-619b49e6-7654-4814-8bfb-625ff8739615 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:22.627499 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-619b49e6-7654-4814-8bfb-625ff8739615 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:22.628638 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-619b49e6-7654-4814-8bfb-625ff8739615 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:22.629098 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-619b49e6-7654-4814-8bfb-625ff8739615 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:22.765182 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-619b49e6-7654-4814-8bfb-625ff8739615 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:22.776686 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-619b49e6-7654-4814-8bfb-625ff8739615 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:22.778512 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-619b49e6-7654-4814-8bfb-625ff8739615 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:22.779690 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-619b49e6-7654-4814-8bfb-625ff8739615 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1795 microversion: 2.20 time: 0.164365 Jul 31 18:40:22.785663 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 227/436] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:40:22 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1795 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:40:30.667789 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-56cb4b72-cd97-43c2-b9d2-bbaad370eced tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:30.668479 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-56cb4b72-cd97-43c2-b9d2-bbaad370eced tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 8ccfba99-9116-4274-a24e-1615c1a661fa] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:30.671360 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=35 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:40:30.677407 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-56cb4b72-cd97-43c2-b9d2-bbaad370eced tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:30.677884 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-56cb4b72-cd97-43c2-b9d2-bbaad370eced tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:30.678925 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-56cb4b72-cd97-43c2-b9d2-bbaad370eced tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:30.679429 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-56cb4b72-cd97-43c2-b9d2-bbaad370eced tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:30.716867 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-56cb4b72-cd97-43c2-b9d2-bbaad370eced tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa/ips" status: 200 len: 149 microversion: 2.1 time: 0.053282 Jul 31 18:40:30.717519 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 210/437] 10.222.0.49 () {58 vars in 1248 bytes} [Sun Jul 31 18:40:30 2022] GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa/ips => generated 149 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:40:30.729748 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-9f3f27ab-596c-4ba9-a179-3e78e332a1a4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b23b2516-c7bb-472c-a952-e2eab84172db"}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:40:30.732142 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-9f3f27ab-596c-4ba9-a179-3e78e332a1a4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 8ccfba99-9116-4274-a24e-1615c1a661fa] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:30.735572 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:40:30.739783 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9f3f27ab-596c-4ba9-a179-3e78e332a1a4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:30.740296 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9f3f27ab-596c-4ba9-a179-3e78e332a1a4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:30.741157 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9f3f27ab-596c-4ba9-a179-3e78e332a1a4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:30.741803 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9f3f27ab-596c-4ba9-a179-3e78e332a1a4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:30.842485 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-9f3f27ab-596c-4ba9-a179-3e78e332a1a4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] HTTP exception thrown: Invalid volume: volume b23b2516-c7bb-472c-a952-e2eab84172db is already attached to instances: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e Jul 31 18:40:30.844519 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-9f3f27ab-596c-4ba9-a179-3e78e332a1a4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Request method failure captured: Jul 31 18:40:30.844519 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: POST /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa/os-volume_attachments HTTP/1.1 Jul 31 18:40:30.844519 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:40:30.844519 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:40:30.844519 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:40:30.844519 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 74 Jul 31 18:40:30.844519 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:40:30.844519 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:40:30.844519 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:40:30.844519 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:40:30.844519 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5svnCPQZeHt0IA40T23IJBlzfc_owbnP881pQWMpE8r05p0cjUmhFB7PWffkD-KRucC_Oyk8QutMV685S7HEr035rVpk89oU9HKa-wvvs-R5fBFQ0CQNEwRf6FMeK1W7edVvwFPexKLrlNGEN1GAEFVnFuiP_-qiW1e52QM8MwBKeEc Jul 31 18:40:30.844519 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:40:30.844519 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:40:30.844519 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:40:30.844519 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:40:30.844519 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:40:30.844519 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:40:30.844519 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:40:30.844519 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:40:30.844519 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:40:30.844519 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:40:30.846029 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8b2df629457c4ff68ad061eb29cb232f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:40:30.846029 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:40:30.846029 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:40:30.846029 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:40:30.846029 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:40:30.846029 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:40:30.846029 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:40:30.846029 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: 88472fa130654657af599106c6aac279 Jul 31 18:40:30.846029 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:40:30.846029 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Jul 31 18:40:30.846029 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {"volumeAttachment": {"volumeId": "b23b2516-c7bb-472c-a952-e2eab84172db"}} Jul 31 18:40:30.846029 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: > Jul 31 18:40:30.846844 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Invalid volume: volume b23b2516-c7bb-472c-a952-e2eab84172db is already attached to instances: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e Jul 31 18:40:30.846844 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'server_id': '8ccfba99-9116-4274-a24e-1615c1a661fa', 'body': {'volumeAttachment': {'volumeId': 'b23b2516-c7bb-472c-a952-e2eab84172db'}}} Jul 31 18:40:30.846844 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:40:30.846844 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:40:30.846844 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 31 18:40:30.846844 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 31 18:40:30.846844 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 18:40:30.846844 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 18:40:30.846844 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 31 18:40:30.846844 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 18:40:30.846844 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 31 18:40:30.846844 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 31 18:40:30.846844 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 31 18:40:30.846844 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 31 18:40:30.846844 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b23b2516-c7bb-472c-a952-e2eab84172db is already attached to instances: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e Jul 31 18:40:30.846844 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:40:30.846844 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:40:30.846844 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:40:30.846844 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:40:30.848796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:40:30.848796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:40:30.848796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:40:30.848796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:40:30.848796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:40:30.848796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:40:30.848796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 18:40:30.848796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 18:40:30.848796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 18:40:30.848796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 18:40:30.848796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 18:40:30.848796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 18:40:30.848796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 31 18:40:30.848796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 31 18:40:30.848796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b23b2516-c7bb-472c-a952-e2eab84172db is already attached to instances: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e Jul 31 18:40:30.848796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:40:30.848796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:40:30.848796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:40:30.848796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:40:30.848796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:40:30.851317 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:40:30.851317 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:40:30.851317 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:40:30.851317 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b23b2516-c7bb-472c-a952-e2eab84172db is already attached to instances: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e Jul 31 18:40:30.851317 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:40:30.851317 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-9f3f27ab-596c-4ba9-a179-3e78e332a1a4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Returning 400 to user: Invalid volume: volume b23b2516-c7bb-472c-a952-e2eab84172db is already attached to instances: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:40:30.851317 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-9f3f27ab-596c-4ba9-a179-3e78e332a1a4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "POST /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.120682 Jul 31 18:40:30.851317 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 228/438] 10.222.0.49 () {60 vars in 1323 bytes} [Sun Jul 31 18:40:30 2022] POST /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa/os-volume_attachments => generated 174 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 18:40:30.857591 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-3a84e434-891c-4897-a6f3-5680d4a83bf0 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:30.858119 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-3a84e434-891c-4897-a6f3-5680d4a83bf0 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 8ccfba99-9116-4274-a24e-1615c1a661fa] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:30.865288 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3a84e434-891c-4897-a6f3-5680d4a83bf0 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:30.865747 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3a84e434-891c-4897-a6f3-5680d4a83bf0 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:30.866635 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3a84e434-891c-4897-a6f3-5680d4a83bf0 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:30.867020 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3a84e434-891c-4897-a6f3-5680d4a83bf0 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:30.895193 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-3a84e434-891c-4897-a6f3-5680d4a83bf0 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 8ccfba99-9116-4274-a24e-1615c1a661fa] Going to try to terminate instance {{(pid=124333) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 18:40:30.986999 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-3a84e434-891c-4897-a6f3-5680d4a83bf0 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa" status: 204 len: 0 microversion: 2.1 time: 0.132995 Jul 31 18:40:30.988822 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 211/439] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:40:30 2022] DELETE /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 18:40:30.998537 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-ef100f1a-c297-4c00-8f74-cfc1e2ace01c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:31.000339 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-ef100f1a-c297-4c00-8f74-cfc1e2ace01c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 8ccfba99-9116-4274-a24e-1615c1a661fa] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:31.009637 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ef100f1a-c297-4c00-8f74-cfc1e2ace01c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:31.010468 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ef100f1a-c297-4c00-8f74-cfc1e2ace01c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:31.011478 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ef100f1a-c297-4c00-8f74-cfc1e2ace01c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:31.012039 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ef100f1a-c297-4c00-8f74-cfc1e2ace01c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:31.166213 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-ef100f1a-c297-4c00-8f74-cfc1e2ace01c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:31.177287 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-ef100f1a-c297-4c00-8f74-cfc1e2ace01c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa" status: 200 len: 1682 microversion: 2.1 time: 0.184652 Jul 31 18:40:31.178257 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 229/440] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:30 2022] GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:32.203794 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-e1326b73-8347-4442-8b0d-3029a1eb5a9b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:32.203794 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-e1326b73-8347-4442-8b0d-3029a1eb5a9b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 8ccfba99-9116-4274-a24e-1615c1a661fa] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:32.224552 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e1326b73-8347-4442-8b0d-3029a1eb5a9b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:32.226336 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e1326b73-8347-4442-8b0d-3029a1eb5a9b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:32.226336 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e1326b73-8347-4442-8b0d-3029a1eb5a9b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:32.226692 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e1326b73-8347-4442-8b0d-3029a1eb5a9b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:32.373094 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-e1326b73-8347-4442-8b0d-3029a1eb5a9b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:32.383337 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-e1326b73-8347-4442-8b0d-3029a1eb5a9b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa" status: 200 len: 1682 microversion: 2.1 time: 0.186357 Jul 31 18:40:32.398751 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 212/441] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:32 2022] GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa => generated 1682 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:33.406677 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-e1faebc0-9e5a-4af4-b698-3bd74a542f0e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:33.407331 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-e1faebc0-9e5a-4af4-b698-3bd74a542f0e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 8ccfba99-9116-4274-a24e-1615c1a661fa] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:33.414199 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e1faebc0-9e5a-4af4-b698-3bd74a542f0e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:33.414932 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e1faebc0-9e5a-4af4-b698-3bd74a542f0e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:33.415701 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e1faebc0-9e5a-4af4-b698-3bd74a542f0e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:33.416131 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e1faebc0-9e5a-4af4-b698-3bd74a542f0e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:33.549584 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-e1faebc0-9e5a-4af4-b698-3bd74a542f0e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:33.551790 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:40:33.558190 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-e1faebc0-9e5a-4af4-b698-3bd74a542f0e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa" status: 200 len: 1682 microversion: 2.1 time: 0.155425 Jul 31 18:40:33.558849 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 230/442] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:33 2022] GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:33.931917 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-6f73d0dc-a8e0-4dd5-9b9e-3f4897464f2a req-92af7b44-b650-4dae-b816-ba7894038a5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ccfba99-9116-4274-a24e-1615c1a661fa", "name": "network-vif-deleted", "tag": "2900adf5-d18f-4ff5-81c3-7e992ab7af76"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:40:33.944194 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-6f73d0dc-a8e0-4dd5-9b9e-3f4897464f2a req-92af7b44-b650-4dae-b816-ba7894038a5b service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:33.944651 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-6f73d0dc-a8e0-4dd5-9b9e-3f4897464f2a req-92af7b44-b650-4dae-b816-ba7894038a5b service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:33.961140 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-6f73d0dc-a8e0-4dd5-9b9e-3f4897464f2a req-92af7b44-b650-4dae-b816-ba7894038a5b service nova] Creating event network-vif-deleted:2900adf5-d18f-4ff5-81c3-7e992ab7af76 for instance 8ccfba99-9116-4274-a24e-1615c1a661fa on hv-cinder-84984 Jul 31 18:40:33.966664 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-6f73d0dc-a8e0-4dd5-9b9e-3f4897464f2a req-92af7b44-b650-4dae-b816-ba7894038a5b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038441 Jul 31 18:40:33.967753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 213/443] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:40:34.581712 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-5c9dde18-402b-444f-b453-3c64a8db111c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:34.583320 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-5c9dde18-402b-444f-b453-3c64a8db111c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 8ccfba99-9116-4274-a24e-1615c1a661fa] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:34.617358 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5c9dde18-402b-444f-b453-3c64a8db111c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:34.619303 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5c9dde18-402b-444f-b453-3c64a8db111c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:34.621656 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5c9dde18-402b-444f-b453-3c64a8db111c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:34.622679 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5c9dde18-402b-444f-b453-3c64a8db111c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:34.654845 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-5c9dde18-402b-444f-b453-3c64a8db111c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] HTTP exception thrown: Instance 8ccfba99-9116-4274-a24e-1615c1a661fa could not be found. Jul 31 18:40:34.657423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-5c9dde18-402b-444f-b453-3c64a8db111c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Request method failure captured: Jul 31 18:40:34.657423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa HTTP/1.1 Jul 31 18:40:34.657423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:40:34.657423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:40:34.657423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:40:34.657423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 0 Jul 31 18:40:34.657423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:40:34.657423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:40:34.657423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:40:34.657423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:40:34.657423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5svnCPQZeHt0IA40T23IJBlzfc_owbnP881pQWMpE8r05p0cjUmhFB7PWffkD-KRucC_Oyk8QutMV685S7HEr035rVpk89oU9HKa-wvvs-R5fBFQ0CQNEwRf6FMeK1W7edVvwFPexKLrlNGEN1GAEFVnFuiP_-qiW1e52QM8MwBKeEc Jul 31 18:40:34.657423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:40:34.657423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:40:34.657423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:40:34.657423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:40:34.657423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:40:34.657423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:40:34.657423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:40:34.657423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:40:34.657423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:40:34.657423 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:40:34.658983 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8b2df629457c4ff68ad061eb29cb232f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:40:34.658983 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:40:34.658983 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:40:34.658983 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:40:34.658983 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:40:34.658983 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:40:34.658983 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:40:34.658983 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: 88472fa130654657af599106c6aac279 Jul 31 18:40:34.658983 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:40:34.658983 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: > Jul 31 18:40:34.658983 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Instance 8ccfba99-9116-4274-a24e-1615c1a661fa could not be found. Jul 31 18:40:34.658983 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'id': '8ccfba99-9116-4274-a24e-1615c1a661fa'} Jul 31 18:40:34.659829 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:40:34.659829 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:40:34.659829 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:40:34.659829 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:40:34.659829 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:40:34.659829 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:40:34.659829 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:40:34.659829 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:40:34.659829 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:40:34.659829 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:40:34.659829 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ccfba99-9116-4274-a24e-1615c1a661fa could not be found. Jul 31 18:40:34.659829 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:40:34.659829 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:40:34.659829 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:40:34.659829 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:40:34.659829 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:40:34.659829 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:40:34.659829 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:40:34.659829 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:40:34.659829 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:40:34.661482 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:40:34.661482 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:40:34.661482 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:40:34.661482 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:40:34.661482 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:40:34.661482 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:40:34.661482 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:40:34.661482 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ccfba99-9116-4274-a24e-1615c1a661fa could not be found. Jul 31 18:40:34.661482 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:40:34.661482 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:40:34.661482 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:40:34.661482 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:40:34.661482 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:40:34.661482 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:40:34.661482 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:40:34.661482 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:40:34.661482 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ccfba99-9116-4274-a24e-1615c1a661fa could not be found. Jul 31 18:40:34.661482 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:40:34.664699 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-5c9dde18-402b-444f-b453-3c64a8db111c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Returning 404 to user: Instance 8ccfba99-9116-4274-a24e-1615c1a661fa could not be found. {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:40:34.665782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-5c9dde18-402b-444f-b453-3c64a8db111c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa" status: 404 len: 111 microversion: 2.1 time: 0.090073 Jul 31 18:40:34.676673 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-b3b01da7-30db-4981-98bc-660c1f6656a4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '.version_select at 0x7f870a1850d0>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:34.682759 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 231/444] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:34 2022] GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 18:40:34.703374 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-b3b01da7-30db-4981-98bc-660c1f6656a4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1860128423" status: 202 len: 0 microversion: 2.1 time: 0.030984 Jul 31 18:40:34.707397 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 214/445] 10.222.0.49 () {58 vars in 1221 bytes} [Sun Jul 31 18:40:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1860128423 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:40:35.734235 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-9a81fabb-bc7c-4020-af3b-0e2a0446fc01 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:35.734771 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-9a81fabb-bc7c-4020-af3b-0e2a0446fc01 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:35.742077 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9a81fabb-bc7c-4020-af3b-0e2a0446fc01 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:35.742525 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9a81fabb-bc7c-4020-af3b-0e2a0446fc01 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:35.743258 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9a81fabb-bc7c-4020-af3b-0e2a0446fc01 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:35.743691 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9a81fabb-bc7c-4020-af3b-0e2a0446fc01 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:35.866622 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.objects.instance [None req-9a81fabb-bc7c-4020-af3b-0e2a0446fc01 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lazy-loading 'services' on Instance uuid f0eb4664-6cc5-455b-909b-ed8a7f69fd8e {{(pid=124334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:40:35.984453 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-9a81fabb-bc7c-4020-af3b-0e2a0446fc01 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e/os-volume_attachments/b23b2516-c7bb-472c-a952-e2eab84172db" status: 202 len: 0 microversion: 2.1 time: 0.253763 Jul 31 18:40:35.984938 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 232/446] 10.222.0.49 () {58 vars in 1416 bytes} [Sun Jul 31 18:40:35 2022] DELETE /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e/os-volume_attachments/b23b2516-c7bb-472c-a952-e2eab84172db => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:40:35.993665 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-5356c3b9-d281-4488-87ea-28ee1747d2df tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:35.995902 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-5356c3b9-d281-4488-87ea-28ee1747d2df tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:36.005279 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5356c3b9-d281-4488-87ea-28ee1747d2df tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:36.006007 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5356c3b9-d281-4488-87ea-28ee1747d2df tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:36.006786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5356c3b9-d281-4488-87ea-28ee1747d2df tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:36.007202 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5356c3b9-d281-4488-87ea-28ee1747d2df tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:36.044058 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-5356c3b9-d281-4488-87ea-28ee1747d2df tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054344 Jul 31 18:40:36.044638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 215/447] 10.222.0.49 () {58 vars in 1302 bytes} [Sun Jul 31 18:40:35 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:40:36.782031 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-ff0f62c7-a2b3-48d5-b254-3e481c965ebb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:36.783733 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-ff0f62c7-a2b3-48d5-b254-3e481c965ebb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:36.790812 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ff0f62c7-a2b3-48d5-b254-3e481c965ebb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:36.791262 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ff0f62c7-a2b3-48d5-b254-3e481c965ebb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:36.792021 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ff0f62c7-a2b3-48d5-b254-3e481c965ebb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:36.792448 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ff0f62c7-a2b3-48d5-b254-3e481c965ebb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:36.885209 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.objects.instance [None req-ff0f62c7-a2b3-48d5-b254-3e481c965ebb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lazy-loading 'services' on Instance uuid a1577f8a-0f79-4b82-9afa-85c86f07cf92 {{(pid=124334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:40:36.965543 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-ff0f62c7-a2b3-48d5-b254-3e481c965ebb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92/os-volume_attachments/7f59a45d-f921-49cd-8dfe-17ce11dbdac0" status: 202 len: 0 microversion: 2.1 time: 0.188348 Jul 31 18:40:36.966356 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 233/448] 10.222.0.49 () {58 vars in 1416 bytes} [Sun Jul 31 18:40:36 2022] DELETE /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92/os-volume_attachments/7f59a45d-f921-49cd-8dfe-17ce11dbdac0 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:40:37.057482 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-1be4efa7-a2fc-49dc-ac9b-fcbdc5f45aea tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:37.060420 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-1be4efa7-a2fc-49dc-ac9b-fcbdc5f45aea tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:37.067885 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1be4efa7-a2fc-49dc-ac9b-fcbdc5f45aea tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:37.068605 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1be4efa7-a2fc-49dc-ac9b-fcbdc5f45aea tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:37.069566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1be4efa7-a2fc-49dc-ac9b-fcbdc5f45aea tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:37.069976 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1be4efa7-a2fc-49dc-ac9b-fcbdc5f45aea tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:37.098558 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-1be4efa7-a2fc-49dc-ac9b-fcbdc5f45aea tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046311 Jul 31 18:40:37.099117 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 216/449] 10.222.0.49 () {58 vars in 1302 bytes} [Sun Jul 31 18:40:37 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 31 18:40:37.162622 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-ea5b8cd6-c89d-4c9d-ad30-a610d42edc13 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:37.163204 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-ea5b8cd6-c89d-4c9d-ad30-a610d42edc13 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:37.169387 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ea5b8cd6-c89d-4c9d-ad30-a610d42edc13 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:37.169827 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ea5b8cd6-c89d-4c9d-ad30-a610d42edc13 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:37.170572 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ea5b8cd6-c89d-4c9d-ad30-a610d42edc13 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:37.171000 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ea5b8cd6-c89d-4c9d-ad30-a610d42edc13 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:37.198695 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-ea5b8cd6-c89d-4c9d-ad30-a610d42edc13 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Going to try to terminate instance {{(pid=124334) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 18:40:37.286311 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-ea5b8cd6-c89d-4c9d-ad30-a610d42edc13 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 204 len: 0 microversion: 2.1 time: 0.127507 Jul 31 18:40:37.287014 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 234/450] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:40:37 2022] DELETE /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 18:40:37.295842 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-01785561-5b99-4c4a-82b7-245fdbfbd026 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:37.296454 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-01785561-5b99-4c4a-82b7-245fdbfbd026 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:37.302587 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-01785561-5b99-4c4a-82b7-245fdbfbd026 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:37.303033 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-01785561-5b99-4c4a-82b7-245fdbfbd026 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:37.303790 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-01785561-5b99-4c4a-82b7-245fdbfbd026 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:37.304216 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-01785561-5b99-4c4a-82b7-245fdbfbd026 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:37.439584 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-01785561-5b99-4c4a-82b7-245fdbfbd026 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:37.447960 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-01785561-5b99-4c4a-82b7-245fdbfbd026 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 200 len: 1682 microversion: 2.1 time: 0.156408 Jul 31 18:40:37.448527 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 217/451] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:37 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:38.471392 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f9056b53-5cdf-4cbe-8446-7a568705e9b1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:38.472162 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-f9056b53-5cdf-4cbe-8446-7a568705e9b1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:38.480700 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f9056b53-5cdf-4cbe-8446-7a568705e9b1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:38.481425 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f9056b53-5cdf-4cbe-8446-7a568705e9b1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:38.482195 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f9056b53-5cdf-4cbe-8446-7a568705e9b1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:38.482625 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f9056b53-5cdf-4cbe-8446-7a568705e9b1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:38.630621 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-f9056b53-5cdf-4cbe-8446-7a568705e9b1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:38.638604 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-f9056b53-5cdf-4cbe-8446-7a568705e9b1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 200 len: 1682 microversion: 2.1 time: 0.173035 Jul 31 18:40:38.639176 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 235/452] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:38 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:39.662815 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-9817a9c7-e980-485c-81d9-463c9fb20179 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:39.663572 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-9817a9c7-e980-485c-81d9-463c9fb20179 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:39.670010 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9817a9c7-e980-485c-81d9-463c9fb20179 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:39.670541 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9817a9c7-e980-485c-81d9-463c9fb20179 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:39.671389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9817a9c7-e980-485c-81d9-463c9fb20179 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:39.671883 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9817a9c7-e980-485c-81d9-463c9fb20179 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:39.908204 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-9817a9c7-e980-485c-81d9-463c9fb20179 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:39.918542 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-9817a9c7-e980-485c-81d9-463c9fb20179 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 200 len: 1682 microversion: 2.1 time: 0.261659 Jul 31 18:40:39.919130 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 218/453] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:39 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 1682 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:40.091001 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-815d2387-5037-4562-a76a-e6d444ce208d req-3b7e038a-278a-4c1e-9054-b43883c96c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0eb4664-6cc5-455b-909b-ed8a7f69fd8e", "name": "network-vif-deleted", "tag": "f31ad60e-e7f8-4d09-9210-49fc69a01236"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:40:40.102180 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-815d2387-5037-4562-a76a-e6d444ce208d req-3b7e038a-278a-4c1e-9054-b43883c96c83 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:40.102625 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-815d2387-5037-4562-a76a-e6d444ce208d req-3b7e038a-278a-4c1e-9054-b43883c96c83 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:40.115339 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-815d2387-5037-4562-a76a-e6d444ce208d req-3b7e038a-278a-4c1e-9054-b43883c96c83 service nova] Creating event network-vif-deleted:f31ad60e-e7f8-4d09-9210-49fc69a01236 for instance f0eb4664-6cc5-455b-909b-ed8a7f69fd8e on hv-cinder-84984 Jul 31 18:40:40.121561 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-815d2387-5037-4562-a76a-e6d444ce208d req-3b7e038a-278a-4c1e-9054-b43883c96c83 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034201 Jul 31 18:40:40.122629 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 236/454] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:40:40.236386 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-6a1f2f87-c04a-4754-9af2-3f1688ed6002 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:40:40.242874 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6a1f2f87-c04a-4754-9af2-3f1688ed6002 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:40.243321 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6a1f2f87-c04a-4754-9af2-3f1688ed6002 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:40.272288 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-6a1f2f87-c04a-4754-9af2-3f1688ed6002 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Going to try to stop instance {{(pid=124333) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 31 18:40:40.324314 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-6a1f2f87-c04a-4754-9af2-3f1688ed6002 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "POST /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92/action" status: 202 len: 0 microversion: 2.1 time: 0.094500 Jul 31 18:40:40.325278 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 219/455] 10.222.0.49 () {60 vars in 1278 bytes} [Sun Jul 31 18:40:40 2022] POST /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:40:40.333839 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-b72822d9-6643-4621-8967-f59c724ef80b tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:40.334795 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-b72822d9-6643-4621-8967-f59c724ef80b tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:40.341157 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b72822d9-6643-4621-8967-f59c724ef80b tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:40.341598 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b72822d9-6643-4621-8967-f59c724ef80b tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:40.342352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b72822d9-6643-4621-8967-f59c724ef80b tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:40.342778 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b72822d9-6643-4621-8967-f59c724ef80b tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:40.476080 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-b72822d9-6643-4621-8967-f59c724ef80b tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:40.486817 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-b72822d9-6643-4621-8967-f59c724ef80b tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1678 microversion: 2.1 time: 0.157048 Jul 31 18:40:40.487844 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 237/456] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:40 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:40.883348 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-bed0bd44-3fb6-4229-bc4d-5b305da65c21 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36041ea7-630c-4f4c-a382-f438ba81fab5"}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:40:40.886160 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-bed0bd44-3fb6-4229-bc4d-5b305da65c21 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:40.893054 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bed0bd44-3fb6-4229-bc4d-5b305da65c21 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:40.893502 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bed0bd44-3fb6-4229-bc4d-5b305da65c21 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:40.894353 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bed0bd44-3fb6-4229-bc4d-5b305da65c21 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:40.894857 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bed0bd44-3fb6-4229-bc4d-5b305da65c21 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:40.897752 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:40:40.940552 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-1df6db75-3f50-45a9-ad6e-beda6261ba17 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:40.941196 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-1df6db75-3f50-45a9-ad6e-beda6261ba17 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:40.953494 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1df6db75-3f50-45a9-ad6e-beda6261ba17 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:40.953963 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1df6db75-3f50-45a9-ad6e-beda6261ba17 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:40.954758 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1df6db75-3f50-45a9-ad6e-beda6261ba17 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:40.955203 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1df6db75-3f50-45a9-ad6e-beda6261ba17 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:40.984585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-1df6db75-3f50-45a9-ad6e-beda6261ba17 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] HTTP exception thrown: Instance f0eb4664-6cc5-455b-909b-ed8a7f69fd8e could not be found. Jul 31 18:40:40.986568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-1df6db75-3f50-45a9-ad6e-beda6261ba17 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Request method failure captured: Jul 31 18:40:40.986568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e HTTP/1.1 Jul 31 18:40:40.986568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:40:40.986568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:40:40.986568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:40:40.986568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 0 Jul 31 18:40:40.986568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:40:40.986568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:40:40.986568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:40:40.986568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:40:40.986568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5svnCPQZeHt0IA40T23IJBlzfc_owbnP881pQWMpE8r05p0cjUmhFB7PWffkD-KRucC_Oyk8QutMV685S7HEr035rVpk89oU9HKa-wvvs-R5fBFQ0CQNEwRf6FMeK1W7edVvwFPexKLrlNGEN1GAEFVnFuiP_-qiW1e52QM8MwBKeEc Jul 31 18:40:40.986568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:40:40.986568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:40:40.986568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:40:40.986568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:40:40.986568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:40:40.986568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:40:40.986568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:40:40.986568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:40:40.986568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:40:40.986568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:40:40.988168 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8b2df629457c4ff68ad061eb29cb232f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:40:40.988168 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:40:40.988168 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:40:40.988168 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:40:40.988168 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:40:40.988168 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:40:40.988168 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:40:40.988168 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: 88472fa130654657af599106c6aac279 Jul 31 18:40:40.988168 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:40:40.988168 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: > Jul 31 18:40:40.988168 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Instance f0eb4664-6cc5-455b-909b-ed8a7f69fd8e could not be found. Jul 31 18:40:40.988168 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'id': 'f0eb4664-6cc5-455b-909b-ed8a7f69fd8e'} Jul 31 18:40:40.989036 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:40:40.989036 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:40:40.989036 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:40:40.989036 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:40:40.989036 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:40:40.989036 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:40:40.989036 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:40:40.989036 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:40:40.989036 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:40:40.989036 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:40:40.989036 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0eb4664-6cc5-455b-909b-ed8a7f69fd8e could not be found. Jul 31 18:40:40.989036 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:40:40.989036 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:40:40.989036 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:40:40.989036 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:40:40.989036 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:40:40.989036 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:40:40.989036 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:40:40.989036 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:40:40.989036 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:40:40.990457 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:40:40.990457 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:40:40.990457 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:40:40.990457 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:40:40.990457 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:40:40.990457 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:40:40.990457 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:40:40.990457 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0eb4664-6cc5-455b-909b-ed8a7f69fd8e could not be found. Jul 31 18:40:40.990457 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:40:40.990457 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:40:40.990457 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:40:40.990457 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:40:40.990457 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:40:40.990457 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:40:40.990457 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:40:40.990457 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:40:40.990457 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0eb4664-6cc5-455b-909b-ed8a7f69fd8e could not be found. Jul 31 18:40:40.990457 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:40:40.992534 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-1df6db75-3f50-45a9-ad6e-beda6261ba17 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Returning 404 to user: Instance f0eb4664-6cc5-455b-909b-ed8a7f69fd8e could not be found. {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:40:40.992534 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-1df6db75-3f50-45a9-ad6e-beda6261ba17 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 404 len: 111 microversion: 2.1 time: 0.053443 Jul 31 18:40:40.992534 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 238/457] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:40 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:40:41.002940 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-07f365b7-7189-4b7b-9877-cc936243cee6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '.version_select at 0x7f87099af940>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:41.012386 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR oslo.messaging._drivers.impl_rabbit [None req-07f365b7-7189-4b7b-9877-cc936243cee6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [73606725-50ca-45da-b569-330c27ba291c] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 31 18:40:41.222458 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-bed0bd44-3fb6-4229-bc4d-5b305da65c21 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "POST /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.344300 Jul 31 18:40:41.228901 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 220/458] 10.222.0.49 () {60 vars in 1323 bytes} [Sun Jul 31 18:40:40 2022] POST /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9/os-volume_attachments => generated 194 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:40:41.510717 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-784171ad-da19-44c2-8e84-2dadb1f9b1ba tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:41.511320 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-784171ad-da19-44c2-8e84-2dadb1f9b1ba tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:41.518580 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-784171ad-da19-44c2-8e84-2dadb1f9b1ba tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:41.519016 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-784171ad-da19-44c2-8e84-2dadb1f9b1ba tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:41.519777 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-784171ad-da19-44c2-8e84-2dadb1f9b1ba tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:41.520218 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-784171ad-da19-44c2-8e84-2dadb1f9b1ba tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:41.666513 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-784171ad-da19-44c2-8e84-2dadb1f9b1ba tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:41.674388 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-784171ad-da19-44c2-8e84-2dadb1f9b1ba tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1678 microversion: 2.1 time: 0.168634 Jul 31 18:40:41.674993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 221/459] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:41 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:42.024572 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO oslo.messaging._drivers.impl_rabbit [None req-07f365b7-7189-4b7b-9877-cc936243cee6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [73606725-50ca-45da-b569-330c27ba291c] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 46234. Jul 31 18:40:42.051220 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-07f365b7-7189-4b7b-9877-cc936243cee6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1383514151" status: 202 len: 0 microversion: 2.1 time: 1.054261 Jul 31 18:40:42.051731 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 239/460] 10.222.0.49 () {58 vars in 1221 bytes} [Sun Jul 31 18:40:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1383514151 => generated 0 bytes in 1056 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:40:42.663295 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-71affcb6-860c-4214-aac0-8bf970e0bf04 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Action: 'create', calling method: .version_select at 0x7f870a23c3a0>, body: {"keypair": {"name": "tempest-keypair-613123085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAddA4GPL4PR3ebS+3+Hv6gkuc5CSrvUmyCab0H9IbrxLoIDkKpZmDC3VL9vGK5jv73tHlYYmWbvh5qb1BYpmKtxNePmvl2KKN73q4B7yVaiIWbelHzMX64+1eSTXYxQEw=="}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:40:42.680409 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-71affcb6-860c-4214-aac0-8bf970e0bf04 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Getting quotas for project 8b2df629457c4ff68ad061eb29cb232f. Resources: {'key_pairs'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:40:42.684497 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-71affcb6-860c-4214-aac0-8bf970e0bf04 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Getting quotas for user 88472fa130654657af599106c6aac279 and project 8b2df629457c4ff68ad061eb29cb232f. Resources: {'key_pairs'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:40:42.695925 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-9f006233-8dbe-4a30-baf8-94a6c22562ef tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:42.696556 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-9f006233-8dbe-4a30-baf8-94a6c22562ef tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:42.703368 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9f006233-8dbe-4a30-baf8-94a6c22562ef tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:42.704171 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9f006233-8dbe-4a30-baf8-94a6c22562ef tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:42.705216 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9f006233-8dbe-4a30-baf8-94a6c22562ef tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:42.705860 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9f006233-8dbe-4a30-baf8-94a6c22562ef tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:42.711378 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-71affcb6-860c-4214-aac0-8bf970e0bf04 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051280 Jul 31 18:40:42.711378 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 222/461] 10.222.0.49 () {60 vars in 1159 bytes} [Sun Jul 31 18:40:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:40:42.843861 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-9f006233-8dbe-4a30-baf8-94a6c22562ef tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:42.852715 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-9f006233-8dbe-4a30-baf8-94a6c22562ef tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1678 microversion: 2.1 time: 0.161134 Jul 31 18:40:42.853600 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 240/462] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:42 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:40:43.874929 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-3794458c-53c8-4866-8620-842e350921df tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:43.875505 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-3794458c-53c8-4866-8620-842e350921df tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:43.884892 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3794458c-53c8-4866-8620-842e350921df tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:43.885281 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3794458c-53c8-4866-8620-842e350921df tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:43.886100 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3794458c-53c8-4866-8620-842e350921df tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:43.886541 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3794458c-53c8-4866-8620-842e350921df tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:44.027615 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-3794458c-53c8-4866-8620-842e350921df tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:44.035145 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-3794458c-53c8-4866-8620-842e350921df tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1678 microversion: 2.1 time: 0.164677 Jul 31 18:40:44.035678 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 223/463] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:43 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:44.055877 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-0acb21d4-4303-41ab-ae01-422a2c0ae84b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1543075217", "imageRef": "6f2a0bb6-2fb3-4536-bee3-23e4e975f079", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf14a566-5800-492e-9819-b36a005e1f98"}], "security_groups": [{"name": "tempest-securitygroup--1470882310"}], "key_name": "tempest-keypair-613123085", "user_data": "}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:40:44.164823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.network.neutron [None req-0acb21d4-4303-41ab-ae01-422a2c0ae84b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] validate_networks() for [('cf14a566-5800-492e-9819-b36a005e1f98', None, None, None, None, None)] {{(pid=124334) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 18:40:44.540380 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-0acb21d4-4303-41ab-ae01-422a2c0ae84b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Flavor limits 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 18:40:44.540803 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-0acb21d4-4303-41ab-ae01-422a2c0ae84b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Image limits 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 18:40:44.541339 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-0acb21d4-4303-41ab-ae01-422a2c0ae84b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Flavor pref 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 18:40:44.541754 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-0acb21d4-4303-41ab-ae01-422a2c0ae84b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Image pref 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 18:40:44.542164 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-0acb21d4-4303-41ab-ae01-422a2c0ae84b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 18:40:44.551986 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0acb21d4-4303-41ab-ae01-422a2c0ae84b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:44.552433 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0acb21d4-4303-41ab-ae01-422a2c0ae84b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:44.553277 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0acb21d4-4303-41ab-ae01-422a2c0ae84b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:44.553710 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0acb21d4-4303-41ab-ae01-422a2c0ae84b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:44.571024 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.quota [None req-0acb21d4-4303-41ab-ae01-422a2c0ae84b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Getting quotas for project 8b2df629457c4ff68ad061eb29cb232f. Resources: {'cores', 'ram', 'instances'} {{(pid=124334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:40:44.575062 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.quota [None req-0acb21d4-4303-41ab-ae01-422a2c0ae84b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Getting quotas for user 88472fa130654657af599106c6aac279 and project 8b2df629457c4ff68ad061eb29cb232f. Resources: {'cores', 'ram', 'instances'} {{(pid=124334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:40:44.586564 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-0acb21d4-4303-41ab-ae01-422a2c0ae84b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Going to run 1 instances... {{(pid=124334) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 18:40:44.588791 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-0acb21d4-4303-41ab-ae01-422a2c0ae84b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f2a0bb6-2fb3-4536-bee3-23e4e975f079',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 18:40:44.640223 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-0acb21d4-4303-41ab-ae01-422a2c0ae84b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.588742 Jul 31 18:40:44.640885 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 241/464] 10.222.0.49 () {60 vars in 1147 bytes} [Sun Jul 31 18:40:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 18:40:44.652257 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-7151cde4-c0d6-4aaa-844f-9a43597661aa tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:44.652888 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-7151cde4-c0d6-4aaa-844f-9a43597661aa tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:44.706650 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-7151cde4-c0d6-4aaa-844f-9a43597661aa tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:44.713575 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-7151cde4-c0d6-4aaa-844f-9a43597661aa tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47" status: 200 len: 1241 microversion: 2.1 time: 0.065437 Jul 31 18:40:44.714144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 224/465] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:44 2022] GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:40:45.056792 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4185d51e-755f-424f-a74e-c8824b263b66 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:45.057411 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-4185d51e-755f-424f-a74e-c8824b263b66 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:45.067446 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4185d51e-755f-424f-a74e-c8824b263b66 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:45.067991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4185d51e-755f-424f-a74e-c8824b263b66 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:45.068865 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4185d51e-755f-424f-a74e-c8824b263b66 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:45.069318 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4185d51e-755f-424f-a74e-c8824b263b66 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:45.202454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-4185d51e-755f-424f-a74e-c8824b263b66 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:45.210350 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-4185d51e-755f-424f-a74e-c8824b263b66 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1678 microversion: 2.1 time: 0.157894 Jul 31 18:40:45.211012 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 242/466] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:45 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:45.735405 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-dd1e8e87-34c2-4252-b445-c9eb0011d76f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:45.736015 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-dd1e8e87-34c2-4252-b445-c9eb0011d76f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:45.744045 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-dd1e8e87-34c2-4252-b445-c9eb0011d76f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:45.744268 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-dd1e8e87-34c2-4252-b445-c9eb0011d76f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:45.745049 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-dd1e8e87-34c2-4252-b445-c9eb0011d76f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:45.745491 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-dd1e8e87-34c2-4252-b445-c9eb0011d76f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:45.844233 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-dd1e8e87-34c2-4252-b445-c9eb0011d76f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:45.851945 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-dd1e8e87-34c2-4252-b445-c9eb0011d76f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47" status: 200 len: 1299 microversion: 2.1 time: 0.121277 Jul 31 18:40:45.852509 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 225/467] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:45 2022] GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47 => generated 1299 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:46.231950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-9e3f5f06-7545-439c-94fb-5f1689904880 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:46.232583 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-9e3f5f06-7545-439c-94fb-5f1689904880 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:46.240741 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9e3f5f06-7545-439c-94fb-5f1689904880 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:46.241238 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9e3f5f06-7545-439c-94fb-5f1689904880 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:46.241996 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9e3f5f06-7545-439c-94fb-5f1689904880 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:46.242420 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9e3f5f06-7545-439c-94fb-5f1689904880 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:46.387800 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-9e3f5f06-7545-439c-94fb-5f1689904880 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:46.395770 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-9e3f5f06-7545-439c-94fb-5f1689904880 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1678 microversion: 2.1 time: 0.167998 Jul 31 18:40:46.396410 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 243/468] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:46 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:46.873521 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-04bd8267-d0ca-426e-8701-be90e9d2bc26 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:46.874163 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-04bd8267-d0ca-426e-8701-be90e9d2bc26 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:46.881903 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-04bd8267-d0ca-426e-8701-be90e9d2bc26 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:46.882313 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-04bd8267-d0ca-426e-8701-be90e9d2bc26 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:46.883152 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-04bd8267-d0ca-426e-8701-be90e9d2bc26 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:46.883580 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-04bd8267-d0ca-426e-8701-be90e9d2bc26 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:47.286848 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-ade99a9f-e8bd-43ac-a0a3-b977b6f9bfc5 req-45351546-b42e-48d6-865c-91bdb634c81b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41338c87-271c-46dc-ba86-88a04da9ac47", "tag": "ca14d319-eb18-44b3-b9de-6ac9f3d7a10f"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:40:47.295481 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-04bd8267-d0ca-426e-8701-be90e9d2bc26 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:47.297640 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-ade99a9f-e8bd-43ac-a0a3-b977b6f9bfc5 req-45351546-b42e-48d6-865c-91bdb634c81b service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:47.298152 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-ade99a9f-e8bd-43ac-a0a3-b977b6f9bfc5 req-45351546-b42e-48d6-865c-91bdb634c81b service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:47.303512 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-04bd8267-d0ca-426e-8701-be90e9d2bc26 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47" status: 200 len: 1367 microversion: 2.1 time: 0.433951 Jul 31 18:40:47.304300 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 226/469] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:46 2022] GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47 => generated 1367 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:47.309777 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-ade99a9f-e8bd-43ac-a0a3-b977b6f9bfc5 req-45351546-b42e-48d6-865c-91bdb634c81b service nova] Creating event network-changed:ca14d319-eb18-44b3-b9de-6ac9f3d7a10f for instance 41338c87-271c-46dc-ba86-88a04da9ac47 on hv-cinder-84984 Jul 31 18:40:47.319154 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-ade99a9f-e8bd-43ac-a0a3-b977b6f9bfc5 req-45351546-b42e-48d6-865c-91bdb634c81b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036134 Jul 31 18:40:47.319812 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 244/470] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:40:47.421953 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-ea7a4a14-9cfe-45eb-b680-7895a0a7fd44 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:47.423019 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-ea7a4a14-9cfe-45eb-b680-7895a0a7fd44 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:47.430482 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ea7a4a14-9cfe-45eb-b680-7895a0a7fd44 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:47.432226 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ea7a4a14-9cfe-45eb-b680-7895a0a7fd44 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:47.433040 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ea7a4a14-9cfe-45eb-b680-7895a0a7fd44 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:47.433531 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ea7a4a14-9cfe-45eb-b680-7895a0a7fd44 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:47.574566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-ea7a4a14-9cfe-45eb-b680-7895a0a7fd44 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:47.582401 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-ea7a4a14-9cfe-45eb-b680-7895a0a7fd44 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1678 microversion: 2.1 time: 0.166997 Jul 31 18:40:47.582966 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 227/471] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:47 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:48.327362 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-3ea38b30-a457-4371-a74f-4961dbf9186b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:48.328018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-3ea38b30-a457-4371-a74f-4961dbf9186b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:48.334791 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3ea38b30-a457-4371-a74f-4961dbf9186b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:48.335263 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3ea38b30-a457-4371-a74f-4961dbf9186b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:48.336317 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3ea38b30-a457-4371-a74f-4961dbf9186b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:48.336902 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3ea38b30-a457-4371-a74f-4961dbf9186b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:48.468806 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-3ea38b30-a457-4371-a74f-4961dbf9186b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:48.477321 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-3ea38b30-a457-4371-a74f-4961dbf9186b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47" status: 200 len: 1367 microversion: 2.1 time: 0.156150 Jul 31 18:40:48.477869 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 245/472] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:48 2022] GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:48.608218 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-31192350-6140-47b4-b64e-40d7e087fa2e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:48.609111 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-31192350-6140-47b4-b64e-40d7e087fa2e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:48.619953 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-31192350-6140-47b4-b64e-40d7e087fa2e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:48.620684 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-31192350-6140-47b4-b64e-40d7e087fa2e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:48.621973 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-31192350-6140-47b4-b64e-40d7e087fa2e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:48.622681 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-31192350-6140-47b4-b64e-40d7e087fa2e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:48.756602 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-31192350-6140-47b4-b64e-40d7e087fa2e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:48.764223 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-31192350-6140-47b4-b64e-40d7e087fa2e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1678 microversion: 2.1 time: 0.162594 Jul 31 18:40:48.764788 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 228/473] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:48 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:48.780454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-5824ccd7-9c01-4f27-ba82-ee286158e0e0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:40:48.782745 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-5824ccd7-9c01-4f27-ba82-ee286158e0e0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:48.789101 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5824ccd7-9c01-4f27-ba82-ee286158e0e0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:48.789524 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5824ccd7-9c01-4f27-ba82-ee286158e0e0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:48.790290 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5824ccd7-9c01-4f27-ba82-ee286158e0e0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:48.790752 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5824ccd7-9c01-4f27-ba82-ee286158e0e0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:48.813924 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.objects.instance [None req-5824ccd7-9c01-4f27-ba82-ee286158e0e0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lazy-loading 'flavor' on Instance uuid 4377ead1-89c3-4e21-b45c-c20dcf7bacf9 {{(pid=124334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:40:48.940062 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:40:48.950573 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-5824ccd7-9c01-4f27-ba82-ee286158e0e0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "POST /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9/action" status: 200 len: 32 microversion: 2.1 time: 0.174176 Jul 31 18:40:48.951170 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 246/474] 10.222.0.49 () {60 vars in 1278 bytes} [Sun Jul 31 18:40:48 2022] POST /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9/action => generated 32 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 18:40:48.960970 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-897c83e5-acac-4a4c-a9af-e415f471117f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:48.961595 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-897c83e5-acac-4a4c-a9af-e415f471117f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:48.968244 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-897c83e5-acac-4a4c-a9af-e415f471117f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:48.968689 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-897c83e5-acac-4a4c-a9af-e415f471117f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:48.969471 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-897c83e5-acac-4a4c-a9af-e415f471117f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:48.969899 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-897c83e5-acac-4a4c-a9af-e415f471117f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:49.110470 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-897c83e5-acac-4a4c-a9af-e415f471117f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:49.119236 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-897c83e5-acac-4a4c-a9af-e415f471117f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1737 microversion: 2.1 time: 0.162143 Jul 31 18:40:49.119734 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 229/475] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:48 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:49.498994 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-055d0803-6071-42cb-a465-5f5bbf757166 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:49.499660 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-055d0803-6071-42cb-a465-5f5bbf757166 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:49.507880 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-055d0803-6071-42cb-a465-5f5bbf757166 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:49.508328 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-055d0803-6071-42cb-a465-5f5bbf757166 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:49.509109 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-055d0803-6071-42cb-a465-5f5bbf757166 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:49.509571 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-055d0803-6071-42cb-a465-5f5bbf757166 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:49.649078 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-055d0803-6071-42cb-a465-5f5bbf757166 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:49.656720 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-055d0803-6071-42cb-a465-5f5bbf757166 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47" status: 200 len: 1367 microversion: 2.1 time: 0.162470 Jul 31 18:40:49.657366 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 247/476] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:49 2022] GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:49.785913 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-4ee4ee33-66fd-416b-8791-d3f50e5595e7 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:49.786648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-4ee4ee33-66fd-416b-8791-d3f50e5595e7 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:49.793959 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4ee4ee33-66fd-416b-8791-d3f50e5595e7 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:49.794409 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4ee4ee33-66fd-416b-8791-d3f50e5595e7 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:49.795492 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4ee4ee33-66fd-416b-8791-d3f50e5595e7 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:49.796082 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4ee4ee33-66fd-416b-8791-d3f50e5595e7 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:49.933664 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-4ee4ee33-66fd-416b-8791-d3f50e5595e7 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:49.941366 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-4ee4ee33-66fd-416b-8791-d3f50e5595e7 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1678 microversion: 2.1 time: 0.159302 Jul 31 18:40:49.941926 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 230/477] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:49 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:50.144831 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-21c82a22-3c49-4041-8db8-d9198bdb049a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:50.145832 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-21c82a22-3c49-4041-8db8-d9198bdb049a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:50.155968 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-21c82a22-3c49-4041-8db8-d9198bdb049a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:50.156704 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-21c82a22-3c49-4041-8db8-d9198bdb049a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:50.158019 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-21c82a22-3c49-4041-8db8-d9198bdb049a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:50.158737 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-21c82a22-3c49-4041-8db8-d9198bdb049a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:50.311850 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-21c82a22-3c49-4041-8db8-d9198bdb049a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:50.320308 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-21c82a22-3c49-4041-8db8-d9198bdb049a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1737 microversion: 2.1 time: 0.181999 Jul 31 18:40:50.320955 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 248/478] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:50 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:50.681245 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-8d123d43-229d-42dd-abb7-3e7c56ad8461 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:50.682235 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-8d123d43-229d-42dd-abb7-3e7c56ad8461 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:50.692155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8d123d43-229d-42dd-abb7-3e7c56ad8461 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:50.692580 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8d123d43-229d-42dd-abb7-3e7c56ad8461 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:50.693402 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8d123d43-229d-42dd-abb7-3e7c56ad8461 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:50.693834 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8d123d43-229d-42dd-abb7-3e7c56ad8461 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:50.830870 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-8d123d43-229d-42dd-abb7-3e7c56ad8461 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:50.838391 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-8d123d43-229d-42dd-abb7-3e7c56ad8461 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47" status: 200 len: 1367 microversion: 2.1 time: 0.163749 Jul 31 18:40:50.838950 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 231/479] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:50 2022] GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:50.966869 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-7e7c6454-bc46-49a2-a631-ab3f4f079182 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:50.967691 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-7e7c6454-bc46-49a2-a631-ab3f4f079182 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:50.976513 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7e7c6454-bc46-49a2-a631-ab3f4f079182 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:50.976991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7e7c6454-bc46-49a2-a631-ab3f4f079182 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:50.977743 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7e7c6454-bc46-49a2-a631-ab3f4f079182 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:50.978168 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7e7c6454-bc46-49a2-a631-ab3f4f079182 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:51.129046 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-7e7c6454-bc46-49a2-a631-ab3f4f079182 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:51.140165 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-7e7c6454-bc46-49a2-a631-ab3f4f079182 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1655 microversion: 2.1 time: 0.179856 Jul 31 18:40:51.140865 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 249/480] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:50 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1655 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:51.161864 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-656998eb-26dd-4b48-a36f-c13181998308 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:40:51.168419 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-656998eb-26dd-4b48-a36f-c13181998308 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:51.168898 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-656998eb-26dd-4b48-a36f-c13181998308 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:51.191499 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-656998eb-26dd-4b48-a36f-c13181998308 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Going to try to start instance {{(pid=124333) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 31 18:40:51.241853 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-656998eb-26dd-4b48-a36f-c13181998308 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "POST /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92/action" status: 202 len: 0 microversion: 2.1 time: 0.083961 Jul 31 18:40:51.242453 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 232/481] 10.222.0.49 () {60 vars in 1278 bytes} [Sun Jul 31 18:40:51 2022] POST /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:40:51.251051 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4a15e69a-7405-47a1-a9ef-23642c409cb4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:51.251653 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-4a15e69a-7405-47a1-a9ef-23642c409cb4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:51.258095 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4a15e69a-7405-47a1-a9ef-23642c409cb4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:51.258589 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4a15e69a-7405-47a1-a9ef-23642c409cb4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:51.259367 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4a15e69a-7405-47a1-a9ef-23642c409cb4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:51.259806 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4a15e69a-7405-47a1-a9ef-23642c409cb4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:51.342378 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-bcf90786-fbac-4240-8e9b-2645c6306c16 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:51.343064 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-bcf90786-fbac-4240-8e9b-2645c6306c16 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:51.349621 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bcf90786-fbac-4240-8e9b-2645c6306c16 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:51.350061 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bcf90786-fbac-4240-8e9b-2645c6306c16 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:51.350804 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bcf90786-fbac-4240-8e9b-2645c6306c16 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:51.351226 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bcf90786-fbac-4240-8e9b-2645c6306c16 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:51.399526 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-4a15e69a-7405-47a1-a9ef-23642c409cb4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:51.407277 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-4a15e69a-7405-47a1-a9ef-23642c409cb4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1664 microversion: 2.1 time: 0.160257 Jul 31 18:40:51.407932 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 250/482] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:51 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1664 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:51.574198 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-bcf90786-fbac-4240-8e9b-2645c6306c16 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:51.583518 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-bcf90786-fbac-4240-8e9b-2645c6306c16 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1737 microversion: 2.1 time: 0.245343 Jul 31 18:40:51.584134 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 233/483] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:51 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1737 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:51.861170 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-eb007fd3-1dc2-4777-97ce-d508ee71cc85 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:51.862393 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-eb007fd3-1dc2-4777-97ce-d508ee71cc85 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:51.870874 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-eb007fd3-1dc2-4777-97ce-d508ee71cc85 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:51.871383 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-eb007fd3-1dc2-4777-97ce-d508ee71cc85 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:51.872842 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-eb007fd3-1dc2-4777-97ce-d508ee71cc85 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:51.873282 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-eb007fd3-1dc2-4777-97ce-d508ee71cc85 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:51.979769 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-fbee03be-bec7-4408-b96a-dfb862d18a0a req-32bf16f5-4765-49de-a276-df8b0bc27d28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41338c87-271c-46dc-ba86-88a04da9ac47", "name": "network-vif-plugged", "status": "completed", "tag": "ca14d319-eb18-44b3-b9de-6ac9f3d7a10f"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:40:51.991069 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-fbee03be-bec7-4408-b96a-dfb862d18a0a req-32bf16f5-4765-49de-a276-df8b0bc27d28 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:51.991666 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-fbee03be-bec7-4408-b96a-dfb862d18a0a req-32bf16f5-4765-49de-a276-df8b0bc27d28 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:52.006268 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-fbee03be-bec7-4408-b96a-dfb862d18a0a req-32bf16f5-4765-49de-a276-df8b0bc27d28 service nova] Creating event network-vif-plugged:ca14d319-eb18-44b3-b9de-6ac9f3d7a10f for instance 41338c87-271c-46dc-ba86-88a04da9ac47 on hv-cinder-84984 Jul 31 18:40:52.011302 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-fbee03be-bec7-4408-b96a-dfb862d18a0a req-32bf16f5-4765-49de-a276-df8b0bc27d28 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035655 Jul 31 18:40:52.011907 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 234/484] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:40:52.018019 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-eb007fd3-1dc2-4777-97ce-d508ee71cc85 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:52.026395 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-eb007fd3-1dc2-4777-97ce-d508ee71cc85 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47" status: 200 len: 1367 microversion: 2.1 time: 0.170981 Jul 31 18:40:52.027773 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 251/485] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:51 2022] GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:52.433559 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-d95081c1-4ad7-4073-be44-7741844e07de tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:52.434739 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-d95081c1-4ad7-4073-be44-7741844e07de tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:52.443822 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d95081c1-4ad7-4073-be44-7741844e07de tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:52.444268 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d95081c1-4ad7-4073-be44-7741844e07de tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:52.445072 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d95081c1-4ad7-4073-be44-7741844e07de tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:52.445502 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d95081c1-4ad7-4073-be44-7741844e07de tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:52.585780 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-d95081c1-4ad7-4073-be44-7741844e07de tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:52.595040 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-d95081c1-4ad7-4073-be44-7741844e07de tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1664 microversion: 2.1 time: 0.168104 Jul 31 18:40:52.595746 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 235/486] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:52 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1664 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:52.605548 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f201c409-526e-4f6e-be64-224b4b4e9d18 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:52.606236 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-f201c409-526e-4f6e-be64-224b4b4e9d18 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:52.614507 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f201c409-526e-4f6e-be64-224b4b4e9d18 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:52.614944 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f201c409-526e-4f6e-be64-224b4b4e9d18 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:52.615728 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f201c409-526e-4f6e-be64-224b4b4e9d18 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:52.616145 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f201c409-526e-4f6e-be64-224b4b4e9d18 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:52.755509 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-f201c409-526e-4f6e-be64-224b4b4e9d18 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:52.767449 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-f201c409-526e-4f6e-be64-224b4b4e9d18 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1737 microversion: 2.1 time: 0.165637 Jul 31 18:40:52.768211 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 252/487] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:52 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:53.052814 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-0fa1caab-1397-4ad5-a8f3-cad82d742754 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:53.053879 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-0fa1caab-1397-4ad5-a8f3-cad82d742754 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:53.064891 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0fa1caab-1397-4ad5-a8f3-cad82d742754 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:53.065630 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0fa1caab-1397-4ad5-a8f3-cad82d742754 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:53.066626 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0fa1caab-1397-4ad5-a8f3-cad82d742754 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:53.067051 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0fa1caab-1397-4ad5-a8f3-cad82d742754 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:53.205246 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-0fa1caab-1397-4ad5-a8f3-cad82d742754 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:53.213328 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-0fa1caab-1397-4ad5-a8f3-cad82d742754 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47" status: 200 len: 1367 microversion: 2.1 time: 0.166847 Jul 31 18:40:53.213895 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 236/488] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:53 2022] GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:53.620694 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-2c0abc83-2ac8-4997-bb1c-16a1f48e2923 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:53.621750 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-2c0abc83-2ac8-4997-bb1c-16a1f48e2923 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:53.631605 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2c0abc83-2ac8-4997-bb1c-16a1f48e2923 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:53.632045 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2c0abc83-2ac8-4997-bb1c-16a1f48e2923 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:53.632815 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2c0abc83-2ac8-4997-bb1c-16a1f48e2923 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:53.633282 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2c0abc83-2ac8-4997-bb1c-16a1f48e2923 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:53.765585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-2c0abc83-2ac8-4997-bb1c-16a1f48e2923 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:53.777059 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-2c0abc83-2ac8-4997-bb1c-16a1f48e2923 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1668 microversion: 2.1 time: 0.162657 Jul 31 18:40:53.777888 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 253/489] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:53 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:53.788408 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-7b5dcaa1-cd0d-4032-b480-5d2c21319ccd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:53.789153 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-7b5dcaa1-cd0d-4032-b480-5d2c21319ccd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:53.795490 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7b5dcaa1-cd0d-4032-b480-5d2c21319ccd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:53.795935 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7b5dcaa1-cd0d-4032-b480-5d2c21319ccd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:53.796698 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7b5dcaa1-cd0d-4032-b480-5d2c21319ccd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:53.797238 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7b5dcaa1-cd0d-4032-b480-5d2c21319ccd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:53.799924 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:40:53.930780 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-7b5dcaa1-cd0d-4032-b480-5d2c21319ccd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:53.939049 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-7b5dcaa1-cd0d-4032-b480-5d2c21319ccd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1737 microversion: 2.1 time: 0.154628 Jul 31 18:40:53.939619 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 237/490] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:53 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:54.237941 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-a5356ac3-5ca0-403a-b09b-c100cf74e4c6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:54.238552 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-a5356ac3-5ca0-403a-b09b-c100cf74e4c6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:54.245362 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a5356ac3-5ca0-403a-b09b-c100cf74e4c6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:54.245802 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a5356ac3-5ca0-403a-b09b-c100cf74e4c6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:54.246562 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a5356ac3-5ca0-403a-b09b-c100cf74e4c6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:54.246991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a5356ac3-5ca0-403a-b09b-c100cf74e4c6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:54.384206 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-a5356ac3-5ca0-403a-b09b-c100cf74e4c6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:54.393378 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-a5356ac3-5ca0-403a-b09b-c100cf74e4c6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47" status: 200 len: 1367 microversion: 2.1 time: 0.161659 Jul 31 18:40:54.394103 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 254/491] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:54 2022] GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:54.961736 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-00356217-a176-44df-9db1-bf0aa6cd79e7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:54.962363 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-00356217-a176-44df-9db1-bf0aa6cd79e7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:54.964671 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell0:SELECT=6 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:40:54.970221 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-00356217-a176-44df-9db1-bf0aa6cd79e7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:54.970664 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-00356217-a176-44df-9db1-bf0aa6cd79e7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:54.971427 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-00356217-a176-44df-9db1-bf0aa6cd79e7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:54.971855 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-00356217-a176-44df-9db1-bf0aa6cd79e7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:55.101309 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-00356217-a176-44df-9db1-bf0aa6cd79e7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:55.110531 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-00356217-a176-44df-9db1-bf0aa6cd79e7 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1737 microversion: 2.1 time: 0.151991 Jul 31 18:40:55.111368 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 238/492] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:54 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:55.419345 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-43e0c54f-3679-4b8a-a261-c7f22af82ed1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:55.420320 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-43e0c54f-3679-4b8a-a261-c7f22af82ed1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:55.423438 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell0:SELECT=2 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:40:55.424524 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell0:SELECT=6 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:40:55.435221 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-43e0c54f-3679-4b8a-a261-c7f22af82ed1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:55.435950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-43e0c54f-3679-4b8a-a261-c7f22af82ed1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:55.437243 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-43e0c54f-3679-4b8a-a261-c7f22af82ed1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:55.437964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-43e0c54f-3679-4b8a-a261-c7f22af82ed1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:55.582937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-43e0c54f-3679-4b8a-a261-c7f22af82ed1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:55.590941 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-43e0c54f-3679-4b8a-a261-c7f22af82ed1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47" status: 200 len: 1558 microversion: 2.1 time: 0.178041 Jul 31 18:40:55.591510 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 255/493] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:55 2022] GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47 => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:55.611834 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-870b8604-eade-4aba-b1c3-e5aced69abb0 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:55.612323 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-870b8604-eade-4aba-b1c3-e5aced69abb0 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:55.618596 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-870b8604-eade-4aba-b1c3-e5aced69abb0 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:55.619036 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-870b8604-eade-4aba-b1c3-e5aced69abb0 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:55.619794 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-870b8604-eade-4aba-b1c3-e5aced69abb0 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:55.620217 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-870b8604-eade-4aba-b1c3-e5aced69abb0 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:55.714575 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-870b8604-eade-4aba-b1c3-e5aced69abb0 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106344 Jul 31 18:40:55.715416 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 239/494] 10.222.0.49 () {58 vars in 1275 bytes} [Sun Jul 31 18:40:55 2022] GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:40:56.132670 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-eec2907a-7063-4b7e-9f00-30e6973b7f76 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:56.133199 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-eec2907a-7063-4b7e-9f00-30e6973b7f76 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:56.139521 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-eec2907a-7063-4b7e-9f00-30e6973b7f76 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:56.139966 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-eec2907a-7063-4b7e-9f00-30e6973b7f76 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:56.140719 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-eec2907a-7063-4b7e-9f00-30e6973b7f76 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:56.141175 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-eec2907a-7063-4b7e-9f00-30e6973b7f76 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:56.271837 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-eec2907a-7063-4b7e-9f00-30e6973b7f76 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:56.279920 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-eec2907a-7063-4b7e-9f00-30e6973b7f76 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1737 microversion: 2.1 time: 0.151828 Jul 31 18:40:56.280701 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 256/495] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:56 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:57.032252 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-05202513-bc13-4780-9d40-c8a83d1e5b5e req-602d65f1-e5ad-451a-bf9c-5ee115a24922 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41338c87-271c-46dc-ba86-88a04da9ac47", "tag": "ca14d319-eb18-44b3-b9de-6ac9f3d7a10f"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:40:57.042362 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-05202513-bc13-4780-9d40-c8a83d1e5b5e req-602d65f1-e5ad-451a-bf9c-5ee115a24922 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:57.042801 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-05202513-bc13-4780-9d40-c8a83d1e5b5e req-602d65f1-e5ad-451a-bf9c-5ee115a24922 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:57.053731 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-05202513-bc13-4780-9d40-c8a83d1e5b5e req-602d65f1-e5ad-451a-bf9c-5ee115a24922 service nova] Creating event network-changed:ca14d319-eb18-44b3-b9de-6ac9f3d7a10f for instance 41338c87-271c-46dc-ba86-88a04da9ac47 on hv-cinder-84984 Jul 31 18:40:57.058816 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-05202513-bc13-4780-9d40-c8a83d1e5b5e req-602d65f1-e5ad-451a-bf9c-5ee115a24922 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030094 Jul 31 18:40:57.059630 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 240/496] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:40:57.303241 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-21432012-cf10-419a-9548-3e22e077144c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:57.304046 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-21432012-cf10-419a-9548-3e22e077144c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:57.311796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-21432012-cf10-419a-9548-3e22e077144c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:57.312232 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-21432012-cf10-419a-9548-3e22e077144c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:57.313138 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-21432012-cf10-419a-9548-3e22e077144c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:57.313502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-21432012-cf10-419a-9548-3e22e077144c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:57.449139 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-21432012-cf10-419a-9548-3e22e077144c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:57.457551 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-21432012-cf10-419a-9548-3e22e077144c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1737 microversion: 2.1 time: 0.159341 Jul 31 18:40:57.460799 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 257/497] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:57 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:58.485614 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-c46eec9d-3ff2-4ca0-a51e-799d96dc2e42 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:58.486781 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-c46eec9d-3ff2-4ca0-a51e-799d96dc2e42 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:58.494261 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c46eec9d-3ff2-4ca0-a51e-799d96dc2e42 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:58.494698 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c46eec9d-3ff2-4ca0-a51e-799d96dc2e42 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:58.495452 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c46eec9d-3ff2-4ca0-a51e-799d96dc2e42 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:58.495880 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c46eec9d-3ff2-4ca0-a51e-799d96dc2e42 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:58.627848 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-c46eec9d-3ff2-4ca0-a51e-799d96dc2e42 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:58.641810 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-c46eec9d-3ff2-4ca0-a51e-799d96dc2e42 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1737 microversion: 2.1 time: 0.164089 Jul 31 18:40:58.642644 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 241/498] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:58 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:40:59.667511 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-60fab82f-e53b-4e3c-a002-ab9fee18709c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:40:59.668315 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-60fab82f-e53b-4e3c-a002-ab9fee18709c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:40:59.677465 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-60fab82f-e53b-4e3c-a002-ab9fee18709c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:59.678061 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-60fab82f-e53b-4e3c-a002-ab9fee18709c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:59.679078 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-60fab82f-e53b-4e3c-a002-ab9fee18709c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:40:59.679662 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-60fab82f-e53b-4e3c-a002-ab9fee18709c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:40:59.812935 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-60fab82f-e53b-4e3c-a002-ab9fee18709c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:40:59.821696 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-60fab82f-e53b-4e3c-a002-ab9fee18709c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1737 microversion: 2.1 time: 0.159510 Jul 31 18:40:59.822266 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 258/499] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:40:59 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:00.851197 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-634de631-353a-40e7-b4f0-e80b17ed3288 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:00.851819 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-634de631-353a-40e7-b4f0-e80b17ed3288 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:00.854802 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:41:00.861870 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-634de631-353a-40e7-b4f0-e80b17ed3288 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:00.862379 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-634de631-353a-40e7-b4f0-e80b17ed3288 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:00.863219 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-634de631-353a-40e7-b4f0-e80b17ed3288 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:00.863685 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-634de631-353a-40e7-b4f0-e80b17ed3288 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:01.003479 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-634de631-353a-40e7-b4f0-e80b17ed3288 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:01.014081 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-634de631-353a-40e7-b4f0-e80b17ed3288 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1737 microversion: 2.1 time: 0.166853 Jul 31 18:41:01.014753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 242/500] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:00 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:02.036947 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-92cd5043-769c-41cd-9bb2-6e2383ec1ed0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:02.037525 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-92cd5043-769c-41cd-9bb2-6e2383ec1ed0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:02.039656 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:41:02.044808 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-92cd5043-769c-41cd-9bb2-6e2383ec1ed0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:02.045257 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-92cd5043-769c-41cd-9bb2-6e2383ec1ed0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:02.046103 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-92cd5043-769c-41cd-9bb2-6e2383ec1ed0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:02.046530 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-92cd5043-769c-41cd-9bb2-6e2383ec1ed0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:02.196707 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-92cd5043-769c-41cd-9bb2-6e2383ec1ed0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:02.205454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-92cd5043-769c-41cd-9bb2-6e2383ec1ed0 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1737 microversion: 2.1 time: 0.172618 Jul 31 18:41:02.206034 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 259/501] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:02 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:03.228186 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-6896421d-8918-47c1-8780-c49d0951d914 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:03.228778 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-6896421d-8918-47c1-8780-c49d0951d914 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:03.235928 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6896421d-8918-47c1-8780-c49d0951d914 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:03.236375 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6896421d-8918-47c1-8780-c49d0951d914 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:03.237168 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6896421d-8918-47c1-8780-c49d0951d914 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:03.237660 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6896421d-8918-47c1-8780-c49d0951d914 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:03.380339 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-6896421d-8918-47c1-8780-c49d0951d914 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:03.391147 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-6896421d-8918-47c1-8780-c49d0951d914 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1737 microversion: 2.1 time: 0.167243 Jul 31 18:41:03.391933 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 243/502] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:03 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:04.301604 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-881a1697-4960-4a72-b416-2c6b24df3319 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:04.302465 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-881a1697-4960-4a72-b416-2c6b24df3319 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:04.310376 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-881a1697-4960-4a72-b416-2c6b24df3319 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:04.310825 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-881a1697-4960-4a72-b416-2c6b24df3319 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:04.311576 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-881a1697-4960-4a72-b416-2c6b24df3319 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:04.312003 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-881a1697-4960-4a72-b416-2c6b24df3319 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:04.341130 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-881a1697-4960-4a72-b416-2c6b24df3319 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f/os-volume_attachments/9b879bc6-ee76-4dbf-9534-41cfa428d1bc" status: 200 len: 194 microversion: 2.20 time: 0.046236 Jul 31 18:41:04.341698 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 260/503] 10.222.0.49 () {60 vars in 1454 bytes} [Sun Jul 31 18:41:04 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f/os-volume_attachments/9b879bc6-ee76-4dbf-9534-41cfa428d1bc => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 18:41:04.407848 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-31fad783-53f5-4d4a-90b5-df2ac0dd4638 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:04.408369 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-31fad783-53f5-4d4a-90b5-df2ac0dd4638 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:04.412081 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-a28af00b-1c0b-43b3-b6ca-8e8405d02fc1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:04.412711 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-a28af00b-1c0b-43b3-b6ca-8e8405d02fc1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:04.415368 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-31fad783-53f5-4d4a-90b5-df2ac0dd4638 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:04.415809 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-31fad783-53f5-4d4a-90b5-df2ac0dd4638 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:04.416567 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-31fad783-53f5-4d4a-90b5-df2ac0dd4638 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:04.417026 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-31fad783-53f5-4d4a-90b5-df2ac0dd4638 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:04.418790 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a28af00b-1c0b-43b3-b6ca-8e8405d02fc1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:04.419247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a28af00b-1c0b-43b3-b6ca-8e8405d02fc1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:04.419987 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a28af00b-1c0b-43b3-b6ca-8e8405d02fc1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:04.420412 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a28af00b-1c0b-43b3-b6ca-8e8405d02fc1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:04.550967 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.objects.instance [None req-31fad783-53f5-4d4a-90b5-df2ac0dd4638 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lazy-loading 'services' on Instance uuid 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f {{(pid=124333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:41:04.559036 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-a28af00b-1c0b-43b3-b6ca-8e8405d02fc1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:04.567426 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-a28af00b-1c0b-43b3-b6ca-8e8405d02fc1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1737 microversion: 2.1 time: 0.159446 Jul 31 18:41:04.568032 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 261/504] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:04 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:41:04.670463 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-31fad783-53f5-4d4a-90b5-df2ac0dd4638 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "DELETE /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f/os-volume_attachments/9b879bc6-ee76-4dbf-9534-41cfa428d1bc" status: 202 len: 0 microversion: 2.20 time: 0.266594 Jul 31 18:41:04.671072 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 244/505] 10.222.0.49 () {60 vars in 1457 bytes} [Sun Jul 31 18:41:04 2022] DELETE /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f/os-volume_attachments/9b879bc6-ee76-4dbf-9534-41cfa428d1bc => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 18:41:04.679838 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-b8e76244-f704-48d2-b6fd-0e799957f4c4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:04.683282 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-b8e76244-f704-48d2-b6fd-0e799957f4c4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:04.690552 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b8e76244-f704-48d2-b6fd-0e799957f4c4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:04.690986 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b8e76244-f704-48d2-b6fd-0e799957f4c4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:04.691775 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b8e76244-f704-48d2-b6fd-0e799957f4c4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:04.692292 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b8e76244-f704-48d2-b6fd-0e799957f4c4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:04.722098 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-b8e76244-f704-48d2-b6fd-0e799957f4c4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046271 Jul 31 18:41:04.722699 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 262/506] 10.222.0.49 () {60 vars in 1343 bytes} [Sun Jul 31 18:41:04 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 18:41:05.591061 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-32f54c52-fbdf-49f7-95d8-2fd8e8494d1b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:05.591754 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-32f54c52-fbdf-49f7-95d8-2fd8e8494d1b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:05.598296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-32f54c52-fbdf-49f7-95d8-2fd8e8494d1b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:05.598758 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-32f54c52-fbdf-49f7-95d8-2fd8e8494d1b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:05.599482 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-32f54c52-fbdf-49f7-95d8-2fd8e8494d1b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:05.599920 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-32f54c52-fbdf-49f7-95d8-2fd8e8494d1b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:05.734004 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-32f54c52-fbdf-49f7-95d8-2fd8e8494d1b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:05.735144 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-94ebb8d0-30e4-4ca9-a242-4d3b2b72b520 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:05.737356 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-94ebb8d0-30e4-4ca9-a242-4d3b2b72b520 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:05.742483 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-32f54c52-fbdf-49f7-95d8-2fd8e8494d1b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1737 microversion: 2.1 time: 0.156428 Jul 31 18:41:05.743177 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 245/507] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:05 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:05.744278 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-94ebb8d0-30e4-4ca9-a242-4d3b2b72b520 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:05.744733 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-94ebb8d0-30e4-4ca9-a242-4d3b2b72b520 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:05.745530 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-94ebb8d0-30e4-4ca9-a242-4d3b2b72b520 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:05.745961 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-94ebb8d0-30e4-4ca9-a242-4d3b2b72b520 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:05.760216 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:41:05.776300 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-94ebb8d0-30e4-4ca9-a242-4d3b2b72b520 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045397 Jul 31 18:41:05.776918 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 263/508] 10.222.0.49 () {60 vars in 1343 bytes} [Sun Jul 31 18:41:05 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:05.838404 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-22abe3c9-b383-4093-bf8e-348196aa6a5f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:05.838894 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-22abe3c9-b383-4093-bf8e-348196aa6a5f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:05.845065 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-22abe3c9-b383-4093-bf8e-348196aa6a5f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:05.845503 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-22abe3c9-b383-4093-bf8e-348196aa6a5f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:05.846247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-22abe3c9-b383-4093-bf8e-348196aa6a5f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:05.846675 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-22abe3c9-b383-4093-bf8e-348196aa6a5f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:05.871093 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-22abe3c9-b383-4093-bf8e-348196aa6a5f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Going to try to terminate instance {{(pid=124333) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 18:41:05.961241 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-22abe3c9-b383-4093-bf8e-348196aa6a5f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "DELETE /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 204 len: 0 microversion: 2.20 time: 0.126459 Jul 31 18:41:05.961852 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 246/509] 10.222.0.49 () {60 vars in 1280 bytes} [Sun Jul 31 18:41:05 2022] DELETE /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 18:41:05.972109 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-ba55ed60-3cb6-47d8-b76c-9136d99e9c97 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:05.972800 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-ba55ed60-3cb6-47d8-b76c-9136d99e9c97 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:05.979410 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ba55ed60-3cb6-47d8-b76c-9136d99e9c97 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:05.979858 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ba55ed60-3cb6-47d8-b76c-9136d99e9c97 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:05.980641 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ba55ed60-3cb6-47d8-b76c-9136d99e9c97 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:05.981072 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ba55ed60-3cb6-47d8-b76c-9136d99e9c97 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:06.112799 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-ba55ed60-3cb6-47d8-b76c-9136d99e9c97 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:06.121220 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-ba55ed60-3cb6-47d8-b76c-9136d99e9c97 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:06.122709 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-ba55ed60-3cb6-47d8-b76c-9136d99e9c97 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:06.123905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-ba55ed60-3cb6-47d8-b76c-9136d99e9c97 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1723 microversion: 2.20 time: 0.156599 Jul 31 18:41:06.124469 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 264/510] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:41:05 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:41:06.767966 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-b8493a31-8075-49c7-8527-328cbafb7b14 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:06.769144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-b8493a31-8075-49c7-8527-328cbafb7b14 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:06.780181 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b8493a31-8075-49c7-8527-328cbafb7b14 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:06.780975 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b8493a31-8075-49c7-8527-328cbafb7b14 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:06.782237 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b8493a31-8075-49c7-8527-328cbafb7b14 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:06.782968 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b8493a31-8075-49c7-8527-328cbafb7b14 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:06.926126 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-b8493a31-8075-49c7-8527-328cbafb7b14 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:06.935081 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-b8493a31-8075-49c7-8527-328cbafb7b14 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1737 microversion: 2.1 time: 0.174166 Jul 31 18:41:06.935680 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 247/511] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:06 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:07.148070 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4b9e957f-3bb6-4d94-864c-543a106eb8e4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:07.148639 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-4b9e957f-3bb6-4d94-864c-543a106eb8e4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:07.155804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4b9e957f-3bb6-4d94-864c-543a106eb8e4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:07.156248 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4b9e957f-3bb6-4d94-864c-543a106eb8e4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:07.157042 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4b9e957f-3bb6-4d94-864c-543a106eb8e4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:07.157470 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4b9e957f-3bb6-4d94-864c-543a106eb8e4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:07.301514 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-4b9e957f-3bb6-4d94-864c-543a106eb8e4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:07.310025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-4b9e957f-3bb6-4d94-864c-543a106eb8e4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:07.311522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-4b9e957f-3bb6-4d94-864c-543a106eb8e4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:07.312696 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-4b9e957f-3bb6-4d94-864c-543a106eb8e4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1723 microversion: 2.20 time: 0.168654 Jul 31 18:41:07.313296 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 265/512] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:41:07 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:41:07.958439 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-40116929-fd43-4719-ad08-b065faad14f1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:07.959069 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-40116929-fd43-4719-ad08-b065faad14f1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:07.965955 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-40116929-fd43-4719-ad08-b065faad14f1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:07.966379 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-40116929-fd43-4719-ad08-b065faad14f1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:07.967157 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-40116929-fd43-4719-ad08-b065faad14f1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:07.967579 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-40116929-fd43-4719-ad08-b065faad14f1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:08.215935 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-40116929-fd43-4719-ad08-b065faad14f1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:08.224662 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-40116929-fd43-4719-ad08-b065faad14f1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1737 microversion: 2.1 time: 0.270028 Jul 31 18:41:08.224802 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 248/513] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:07 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1737 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:08.345724 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-23c0a457-6c4e-4c7a-8a9b-92b865173277 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:08.346504 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-23c0a457-6c4e-4c7a-8a9b-92b865173277 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:08.353558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-23c0a457-6c4e-4c7a-8a9b-92b865173277 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:08.354004 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-23c0a457-6c4e-4c7a-8a9b-92b865173277 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:08.354763 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-23c0a457-6c4e-4c7a-8a9b-92b865173277 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:08.355192 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-23c0a457-6c4e-4c7a-8a9b-92b865173277 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:08.418009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-23c0a457-6c4e-4c7a-8a9b-92b865173277 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:08.426151 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-23c0a457-6c4e-4c7a-8a9b-92b865173277 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:08.427632 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-23c0a457-6c4e-4c7a-8a9b-92b865173277 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:08.428852 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-23c0a457-6c4e-4c7a-8a9b-92b865173277 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 200 len: 1655 microversion: 2.20 time: 0.087859 Jul 31 18:41:08.429415 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 266/514] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:41:08 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 1655 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:41:08.648419 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-c080c930-c2c0-45ca-b3c1-0e14ed8bd936 req-cd3d7be2-f826-45c8-af38-331b9d067bdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "432e6c6a-9a11-4f18-8dbe-fbb82e95f39f", "name": "network-vif-deleted", "tag": "2a079287-92d9-4c25-bdec-babc0efb1738"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:41:08.658049 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-c080c930-c2c0-45ca-b3c1-0e14ed8bd936 req-cd3d7be2-f826-45c8-af38-331b9d067bdc service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:08.658486 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-c080c930-c2c0-45ca-b3c1-0e14ed8bd936 req-cd3d7be2-f826-45c8-af38-331b9d067bdc service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:08.670341 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-c080c930-c2c0-45ca-b3c1-0e14ed8bd936 req-cd3d7be2-f826-45c8-af38-331b9d067bdc service nova] Creating event network-vif-deleted:2a079287-92d9-4c25-bdec-babc0efb1738 for instance 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f on hv-cinder-84984 Jul 31 18:41:08.675237 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-c080c930-c2c0-45ca-b3c1-0e14ed8bd936 req-cd3d7be2-f826-45c8-af38-331b9d067bdc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030380 Jul 31 18:41:08.676084 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 249/515] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:41:09.246550 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-ab6fd3cc-2e47-4c94-a6de-51c42e92a6fd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:09.247527 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-ab6fd3cc-2e47-4c94-a6de-51c42e92a6fd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:09.254265 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ab6fd3cc-2e47-4c94-a6de-51c42e92a6fd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:09.254738 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ab6fd3cc-2e47-4c94-a6de-51c42e92a6fd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:09.255495 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ab6fd3cc-2e47-4c94-a6de-51c42e92a6fd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:09.255924 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ab6fd3cc-2e47-4c94-a6de-51c42e92a6fd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:09.393880 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-ab6fd3cc-2e47-4c94-a6de-51c42e92a6fd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:09.404035 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-ab6fd3cc-2e47-4c94-a6de-51c42e92a6fd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1737 microversion: 2.1 time: 0.161331 Jul 31 18:41:09.404877 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 267/516] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:09 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:09.452777 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-74dbd306-8dfd-4875-91bf-50cb1ebcb9cd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:09.453477 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-74dbd306-8dfd-4875-91bf-50cb1ebcb9cd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:09.460122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-74dbd306-8dfd-4875-91bf-50cb1ebcb9cd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:09.460571 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-74dbd306-8dfd-4875-91bf-50cb1ebcb9cd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:09.461465 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-74dbd306-8dfd-4875-91bf-50cb1ebcb9cd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:09.461917 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-74dbd306-8dfd-4875-91bf-50cb1ebcb9cd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:09.475917 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-74dbd306-8dfd-4875-91bf-50cb1ebcb9cd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] HTTP exception thrown: Instance 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f could not be found. Jul 31 18:41:09.477684 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-74dbd306-8dfd-4875-91bf-50cb1ebcb9cd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Request method failure captured: Jul 31 18:41:09.477684 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f HTTP/1.1 Jul 31 18:41:09.477684 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:41:09.477684 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:41:09.477684 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:41:09.477684 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:41:09.477684 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:41:09.477684 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:41:09.477684 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:41:09.477684 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:41:09.477684 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5svjSuR5N4dB2eCKwtgsXgLl_WFPhajDm9bsR4kFoBsxpn-r1C3B1szd5mu0y_e7hPNdp_RaLMfKilXJF-PbPnquuFcGMXnes1A2ED6kR-3qePmosPOtip_2OVenbVDeD1iebRbb5cF91SybT8fp7wdFop6zP5MVSYqGCQNjmLkvyzs Jul 31 18:41:09.477684 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:41:09.477684 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:41:09.477684 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:41:09.477684 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:41:09.477684 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Openstack-Nova-Api-Version: 2.20 Jul 31 18:41:09.477684 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:41:09.477684 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:41:09.477684 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: 2269cace554c401a8b6a6303ff4e4da8 Jul 31 18:41:09.477684 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1727691475 Jul 31 18:41:09.477684 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:41:09.477684 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:41:09.479149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2269cace554c401a8b6a6303ff4e4da8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2269cace554c401a8b6a6303ff4e4da8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2269cace554c401a8b6a6303ff4e4da8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2269cace554c401a8b6a6303ff4e4da8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:41:09.479149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1727691475 Jul 31 18:41:09.479149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: 2269cace554c401a8b6a6303ff4e4da8 Jul 31 18:41:09.479149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1727691475 Jul 31 18:41:09.479149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-AttachVolumeShelveTestJSON-1727691475-project Jul 31 18:41:09.479149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:41:09.479149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:41:09.479149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 120c06d6dee6425ea5366b363d5a5f7e Jul 31 18:41:09.479149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1727691475-project Jul 31 18:41:09.479149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: > Jul 31 18:41:09.479149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Instance 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f could not be found. Jul 31 18:41:09.479149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': '432e6c6a-9a11-4f18-8dbe-fbb82e95f39f'} Jul 31 18:41:09.480400 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:41:09.480400 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:41:09.480400 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:41:09.480400 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:41:09.480400 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:41:09.480400 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:41:09.480400 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:41:09.480400 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:41:09.480400 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:41:09.480400 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:41:09.480400 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f could not be found. Jul 31 18:41:09.480400 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:41:09.480400 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:41:09.480400 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:41:09.480400 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:41:09.480400 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:41:09.480400 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:41:09.480400 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:41:09.480400 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:41:09.480400 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:41:09.481889 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:41:09.481889 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:41:09.481889 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:41:09.481889 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:41:09.481889 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:41:09.481889 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:41:09.481889 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:41:09.481889 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f could not be found. Jul 31 18:41:09.481889 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:41:09.481889 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:41:09.481889 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:41:09.481889 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:41:09.481889 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:41:09.481889 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:41:09.481889 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:41:09.481889 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:41:09.481889 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f could not be found. Jul 31 18:41:09.481889 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:41:09.483176 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-74dbd306-8dfd-4875-91bf-50cb1ebcb9cd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Returning 404 to user: Instance 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:41:09.483176 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-74dbd306-8dfd-4875-91bf-50cb1ebcb9cd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 404 len: 111 microversion: 2.20 time: 0.031138 Jul 31 18:41:09.483176 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 250/517] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:41:09 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 18:41:09.488475 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4aa56195-1986-42b6-8df1-ac52ff52d114 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '.version_select at 0x7f8709935310>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:09.508924 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-4aa56195-1986-42b6-8df1-ac52ff52d114 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1415744113" status: 204 len: 0 microversion: 2.20 time: 0.024311 Jul 31 18:41:09.509520 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 268/518] 10.222.0.49 () {60 vars in 1262 bytes} [Sun Jul 31 18:41:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1415744113 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 18:41:10.147773 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-52faaa40-8478-4db2-954e-96d54fe74b4e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Action: 'create', calling method: .version_select at 0x7f870a17faf0>, body: {"keypair": {"name": "tempest-keypair-854467955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL03fusJXnLp5ENcKLIzzD+PR1OIdu94I/P62TCi7wUv4xieygHA4PMhs1zca1n22ka4V8mBz6q1+aM9N9WklG8OTmYhXSIUEBt4w6Yvbk/z8WLG59g5toila10JeTXbtg=="}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:41:10.164184 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-52faaa40-8478-4db2-954e-96d54fe74b4e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Getting quotas for project 2269cace554c401a8b6a6303ff4e4da8. Resources: {'key_pairs'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:41:10.168526 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-52faaa40-8478-4db2-954e-96d54fe74b4e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Getting quotas for user 120c06d6dee6425ea5366b363d5a5f7e and project 2269cace554c401a8b6a6303ff4e4da8. Resources: {'key_pairs'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:41:10.196565 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-52faaa40-8478-4db2-954e-96d54fe74b4e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.052342 Jul 31 18:41:10.197472 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 251/519] 10.222.0.49 () {62 vars in 1200 bytes} [Sun Jul 31 18:41:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 31 18:41:10.427805 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-142c2eae-e771-4687-b84f-3d3a11a92ba1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:10.428373 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-142c2eae-e771-4687-b84f-3d3a11a92ba1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:10.434880 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-142c2eae-e771-4687-b84f-3d3a11a92ba1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:10.435324 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-142c2eae-e771-4687-b84f-3d3a11a92ba1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:10.436130 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-142c2eae-e771-4687-b84f-3d3a11a92ba1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:10.436564 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-142c2eae-e771-4687-b84f-3d3a11a92ba1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:10.572376 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-142c2eae-e771-4687-b84f-3d3a11a92ba1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:10.581836 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-142c2eae-e771-4687-b84f-3d3a11a92ba1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1737 microversion: 2.1 time: 0.158571 Jul 31 18:41:10.582407 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 269/520] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:10 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:11.562945 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-1240b471-14a9-4924-a827-ce1a0833b00f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-222646245", "imageRef": "6f2a0bb6-2fb3-4536-bee3-23e4e975f079", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3dc6b6b8-baff-4122-86db-debe82c87f7f"}], "security_groups": [{"name": "tempest-securitygroup--571850071"}], "key_name": "tempest-keypair-854467955", "user_data": "}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:41:11.602928 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-583990cd-2ba2-4096-927b-4ab37c5cb56c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:11.603578 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-583990cd-2ba2-4096-927b-4ab37c5cb56c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:11.610521 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-583990cd-2ba2-4096-927b-4ab37c5cb56c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:11.610629 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-583990cd-2ba2-4096-927b-4ab37c5cb56c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:11.611455 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-583990cd-2ba2-4096-927b-4ab37c5cb56c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:11.611873 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-583990cd-2ba2-4096-927b-4ab37c5cb56c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:11.675581 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.network.neutron [None req-1240b471-14a9-4924-a827-ce1a0833b00f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] validate_networks() for [('3dc6b6b8-baff-4122-86db-debe82c87f7f', None, None, None, None, None)] {{(pid=124333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 18:41:11.744705 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-583990cd-2ba2-4096-927b-4ab37c5cb56c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:11.754344 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-583990cd-2ba2-4096-927b-4ab37c5cb56c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1737 microversion: 2.1 time: 0.155257 Jul 31 18:41:11.754924 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 270/521] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:11 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:41:12.329383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-1240b471-14a9-4924-a827-ce1a0833b00f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Flavor limits 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 18:41:12.329796 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-1240b471-14a9-4924-a827-ce1a0833b00f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Image limits 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 18:41:12.330259 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-1240b471-14a9-4924-a827-ce1a0833b00f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Flavor pref 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 18:41:12.330686 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-1240b471-14a9-4924-a827-ce1a0833b00f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Image pref 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 18:41:12.331110 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-1240b471-14a9-4924-a827-ce1a0833b00f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 18:41:12.341926 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1240b471-14a9-4924-a827-ce1a0833b00f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:12.342591 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1240b471-14a9-4924-a827-ce1a0833b00f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:12.343722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1240b471-14a9-4924-a827-ce1a0833b00f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:12.344339 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1240b471-14a9-4924-a827-ce1a0833b00f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:12.367426 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-1240b471-14a9-4924-a827-ce1a0833b00f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Getting quotas for project 2269cace554c401a8b6a6303ff4e4da8. Resources: {'cores', 'ram', 'instances'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:41:12.372698 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-1240b471-14a9-4924-a827-ce1a0833b00f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Getting quotas for user 120c06d6dee6425ea5366b363d5a5f7e and project 2269cace554c401a8b6a6303ff4e4da8. Resources: {'cores', 'ram', 'instances'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:41:12.391676 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-1240b471-14a9-4924-a827-ce1a0833b00f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Going to run 1 instances... {{(pid=124333) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 18:41:12.393984 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-1240b471-14a9-4924-a827-ce1a0833b00f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f2a0bb6-2fb3-4536-bee3-23e4e975f079',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 18:41:12.441169 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-1240b471-14a9-4924-a827-ce1a0833b00f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.883235 Jul 31 18:41:12.441814 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 252/522] 10.222.0.49 () {62 vars in 1188 bytes} [Sun Jul 31 18:41:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 31 18:41:12.454640 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f02bd6f8-7565-43cc-acac-79c6f6d5584d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:12.455399 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-f02bd6f8-7565-43cc-acac-79c6f6d5584d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:12.510850 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-f02bd6f8-7565-43cc-acac-79c6f6d5584d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:12.518098 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-f02bd6f8-7565-43cc-acac-79c6f6d5584d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:12.519581 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-f02bd6f8-7565-43cc-acac-79c6f6d5584d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:12.520673 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-f02bd6f8-7565-43cc-acac-79c6f6d5584d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1280 microversion: 2.20 time: 0.071640 Jul 31 18:41:12.521262 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 271/523] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:41:12 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:41:12.776476 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-6b7c904c-079b-49b9-91e3-d0492acda142 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:12.777227 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-6b7c904c-079b-49b9-91e3-d0492acda142 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:12.783543 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6b7c904c-079b-49b9-91e3-d0492acda142 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:12.784062 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6b7c904c-079b-49b9-91e3-d0492acda142 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:12.785090 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6b7c904c-079b-49b9-91e3-d0492acda142 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:12.785478 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6b7c904c-079b-49b9-91e3-d0492acda142 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:12.914604 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-6b7c904c-079b-49b9-91e3-d0492acda142 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:12.922641 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-6b7c904c-079b-49b9-91e3-d0492acda142 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1737 microversion: 2.1 time: 0.150980 Jul 31 18:41:12.923202 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 253/524] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:12 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:13.546975 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-9f204a66-6baa-422e-a5e6-90a387f064d6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:13.547814 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-9f204a66-6baa-422e-a5e6-90a387f064d6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:13.558209 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9f204a66-6baa-422e-a5e6-90a387f064d6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:13.558651 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9f204a66-6baa-422e-a5e6-90a387f064d6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:13.559420 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9f204a66-6baa-422e-a5e6-90a387f064d6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:13.559877 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9f204a66-6baa-422e-a5e6-90a387f064d6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:13.625921 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-9f204a66-6baa-422e-a5e6-90a387f064d6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:13.634445 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-9f204a66-6baa-422e-a5e6-90a387f064d6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:13.635930 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-9f204a66-6baa-422e-a5e6-90a387f064d6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:13.637081 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-9f204a66-6baa-422e-a5e6-90a387f064d6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1332 microversion: 2.20 time: 0.096370 Jul 31 18:41:13.637845 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 272/525] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:41:13 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:41:13.943899 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-9497917c-bfdd-487a-be87-5f54ddd8a5c6 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:13.944457 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-9497917c-bfdd-487a-be87-5f54ddd8a5c6 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:13.951473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9497917c-bfdd-487a-be87-5f54ddd8a5c6 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:13.951918 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9497917c-bfdd-487a-be87-5f54ddd8a5c6 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:13.952689 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9497917c-bfdd-487a-be87-5f54ddd8a5c6 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:13.953147 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9497917c-bfdd-487a-be87-5f54ddd8a5c6 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:14.176483 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-9497917c-bfdd-487a-be87-5f54ddd8a5c6 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:14.186727 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-9497917c-bfdd-487a-be87-5f54ddd8a5c6 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1717 microversion: 2.1 time: 0.246757 Jul 31 18:41:14.187331 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 254/526] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:13 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1717 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:14.298316 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-b73026a4-6080-4575-8f86-902444b61c9d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:14.298810 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-b73026a4-6080-4575-8f86-902444b61c9d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:14.304876 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b73026a4-6080-4575-8f86-902444b61c9d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:14.305322 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b73026a4-6080-4575-8f86-902444b61c9d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:14.306079 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b73026a4-6080-4575-8f86-902444b61c9d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:14.306508 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b73026a4-6080-4575-8f86-902444b61c9d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:14.386700 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-b73026a4-6080-4575-8f86-902444b61c9d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] HTTP exception thrown: Cannot 'detach_volume' instance 4377ead1-89c3-4e21-b45c-c20dcf7bacf9 while it is in vm_state rescued Jul 31 18:41:14.388311 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-b73026a4-6080-4575-8f86-902444b61c9d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Request method failure captured: Jul 31 18:41:14.388311 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: DELETE /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9/os-volume_attachments/36041ea7-630c-4f4c-a382-f438ba81fab5 HTTP/1.1 Jul 31 18:41:14.388311 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:41:14.388311 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:41:14.388311 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:41:14.388311 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 0 Jul 31 18:41:14.388311 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:41:14.388311 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:41:14.388311 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:41:14.388311 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:41:14.388311 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5svqlSgAB4kxDyQMdh6aFEcG7207X-UJC0pKHGAD88jUgWbbHA6dn_dW8BxMSIO-xgFN0o9hHxSIysSfnyB4V_TuR2QA6dHUqROz7OQx54TYPajwpKM0xUhk144NLdqXybv-XuN5zssUIo7q5QZ5Kvc-1-m2LH7B1BXkySwY7cMaByk Jul 31 18:41:14.388311 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:41:14.388311 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:41:14.388311 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:41:14.388311 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:41:14.388311 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:41:14.388311 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:41:14.388311 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: df42ccb208664e04ac753b0c64b4fab7 Jul 31 18:41:14.388311 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599579080 Jul 31 18:41:14.388311 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:41:14.388311 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:41:14.389823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/df42ccb208664e04ac753b0c64b4fab7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_df42ccb208664e04ac753b0c64b4fab7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/df42ccb208664e04ac753b0c64b4fab7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/df42ccb208664e04ac753b0c64b4fab7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:41:14.389823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599579080 Jul 31 18:41:14.389823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: df42ccb208664e04ac753b0c64b4fab7 Jul 31 18:41:14.389823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599579080 Jul 31 18:41:14.389823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-ServerRescueNegativeTestJSON-1599579080-project Jul 31 18:41:14.389823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:41:14.389823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:41:14.389823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: 0d7ed577305d48c795f280e49b438bfc Jul 31 18:41:14.389823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599579080-project Jul 31 18:41:14.389823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: > Jul 31 18:41:14.389823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Cannot 'detach_volume' instance 4377ead1-89c3-4e21-b45c-c20dcf7bacf9 while it is in vm_state rescued Jul 31 18:41:14.393828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'server_id': '4377ead1-89c3-4e21-b45c-c20dcf7bacf9', 'id': '36041ea7-630c-4f4c-a382-f438ba81fab5'} Jul 31 18:41:14.393828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:41:14.393828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:41:14.393828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 31 18:41:14.393828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 31 18:41:14.393828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 18:41:14.393828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 18:41:14.393828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 31 18:41:14.393828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 31 18:41:14.393828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4377ead1-89c3-4e21-b45c-c20dcf7bacf9 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 31 18:41:14.393828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:41:14.393828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:41:14.393828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:41:14.393828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:41:14.393828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:41:14.393828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:41:14.393828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:41:14.393828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:41:14.393828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:41:14.393828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:41:14.395003 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 31 18:41:14.395003 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 31 18:41:14.395003 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 31 18:41:14.395003 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 31 18:41:14.395003 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4377ead1-89c3-4e21-b45c-c20dcf7bacf9 while it is in vm_state rescued Jul 31 18:41:14.395003 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:41:14.395003 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:41:14.395003 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:41:14.395003 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:41:14.395003 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:41:14.395003 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:41:14.395003 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:41:14.395003 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:41:14.395003 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4377ead1-89c3-4e21-b45c-c20dcf7bacf9 while it is in vm_state rescued Jul 31 18:41:14.395003 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:41:14.395003 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-b73026a4-6080-4575-8f86-902444b61c9d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Returning 409 to user: Cannot 'detach_volume' instance 4377ead1-89c3-4e21-b45c-c20dcf7bacf9 while it is in vm_state rescued {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:41:14.395922 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-b73026a4-6080-4575-8f86-902444b61c9d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9/os-volume_attachments/36041ea7-630c-4f4c-a382-f438ba81fab5" status: 409 len: 152 microversion: 2.1 time: 0.095443 Jul 31 18:41:14.395922 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 273/527] 10.222.0.49 () {58 vars in 1416 bytes} [Sun Jul 31 18:41:14 2022] DELETE /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9/os-volume_attachments/36041ea7-630c-4f4c-a382-f438ba81fab5 => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 31 18:41:14.399404 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-602fc410-042f-4579-b33d-07da8e34a00f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:41:14.400029 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-602fc410-042f-4579-b33d-07da8e34a00f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:14.408187 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-602fc410-042f-4579-b33d-07da8e34a00f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:14.408695 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-602fc410-042f-4579-b33d-07da8e34a00f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:14.409670 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-602fc410-042f-4579-b33d-07da8e34a00f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:14.410204 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-602fc410-042f-4579-b33d-07da8e34a00f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:14.425618 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:41:14.491285 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-602fc410-042f-4579-b33d-07da8e34a00f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "POST /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9/action" status: 202 len: 0 microversion: 2.1 time: 0.096257 Jul 31 18:41:14.491931 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 255/528] 10.222.0.49 () {60 vars in 1278 bytes} [Sun Jul 31 18:41:14 2022] POST /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:41:14.508702 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-0a39e07f-495f-4a87-9659-995452e84557 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:14.509606 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-0a39e07f-495f-4a87-9659-995452e84557 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:14.522122 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0a39e07f-495f-4a87-9659-995452e84557 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:14.522962 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0a39e07f-495f-4a87-9659-995452e84557 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:14.526848 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0a39e07f-495f-4a87-9659-995452e84557 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:14.527401 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0a39e07f-495f-4a87-9659-995452e84557 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:14.662477 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-e2a5067a-474c-4b93-bd19-207ea3cba83e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:14.663247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-e2a5067a-474c-4b93-bd19-207ea3cba83e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:14.670566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e2a5067a-474c-4b93-bd19-207ea3cba83e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:14.671027 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e2a5067a-474c-4b93-bd19-207ea3cba83e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:14.671882 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e2a5067a-474c-4b93-bd19-207ea3cba83e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:14.672381 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e2a5067a-474c-4b93-bd19-207ea3cba83e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:14.682075 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-0a39e07f-495f-4a87-9659-995452e84557 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:14.690404 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-0a39e07f-495f-4a87-9659-995452e84557 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1725 microversion: 2.1 time: 0.194080 Jul 31 18:41:14.690972 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 274/529] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:14 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:15.020493 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-e2a5067a-474c-4b93-bd19-207ea3cba83e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:15.029028 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-e2a5067a-474c-4b93-bd19-207ea3cba83e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:15.030514 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-e2a5067a-474c-4b93-bd19-207ea3cba83e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:15.031660 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-e2a5067a-474c-4b93-bd19-207ea3cba83e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1405 microversion: 2.20 time: 0.373530 Jul 31 18:41:15.032182 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 256/530] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:41:14 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1405 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:41:15.557761 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-b78d767a-a974-4400-9b99-78b98cb440dd req-bce41bda-9c2d-41be-a096-3a33d58a2ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c1da82e-1477-4392-a5db-0113b56cf487", "tag": "c4842848-d109-451e-bfa5-d8934595abaf"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:41:15.572214 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-b78d767a-a974-4400-9b99-78b98cb440dd req-bce41bda-9c2d-41be-a096-3a33d58a2ff1 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:15.572708 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-b78d767a-a974-4400-9b99-78b98cb440dd req-bce41bda-9c2d-41be-a096-3a33d58a2ff1 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:15.585268 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-b78d767a-a974-4400-9b99-78b98cb440dd req-bce41bda-9c2d-41be-a096-3a33d58a2ff1 service nova] Creating event network-changed:c4842848-d109-451e-bfa5-d8934595abaf for instance 8c1da82e-1477-4392-a5db-0113b56cf487 on hv-cinder-84984 Jul 31 18:41:15.590194 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-b78d767a-a974-4400-9b99-78b98cb440dd req-bce41bda-9c2d-41be-a096-3a33d58a2ff1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038057 Jul 31 18:41:15.590828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 275/531] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:41:15.711877 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-57694ea0-0083-4243-b7a2-0a2127c147d1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:15.712472 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-57694ea0-0083-4243-b7a2-0a2127c147d1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:15.718865 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-57694ea0-0083-4243-b7a2-0a2127c147d1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:15.719316 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-57694ea0-0083-4243-b7a2-0a2127c147d1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:15.720066 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-57694ea0-0083-4243-b7a2-0a2127c147d1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:15.720497 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-57694ea0-0083-4243-b7a2-0a2127c147d1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:15.848935 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-57694ea0-0083-4243-b7a2-0a2127c147d1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:15.857245 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-57694ea0-0083-4243-b7a2-0a2127c147d1 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1725 microversion: 2.1 time: 0.149298 Jul 31 18:41:15.857820 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 257/532] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:15 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:16.061903 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-e60206df-6b4e-46cc-96e0-efcb4fbe1cbe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:16.062929 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-e60206df-6b4e-46cc-96e0-efcb4fbe1cbe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:16.073780 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e60206df-6b4e-46cc-96e0-efcb4fbe1cbe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:16.074226 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e60206df-6b4e-46cc-96e0-efcb4fbe1cbe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:16.074987 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e60206df-6b4e-46cc-96e0-efcb4fbe1cbe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:16.075419 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e60206df-6b4e-46cc-96e0-efcb4fbe1cbe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:16.207386 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-e60206df-6b4e-46cc-96e0-efcb4fbe1cbe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:16.219710 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-e60206df-6b4e-46cc-96e0-efcb4fbe1cbe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:16.222058 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-e60206df-6b4e-46cc-96e0-efcb4fbe1cbe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:16.223637 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-e60206df-6b4e-46cc-96e0-efcb4fbe1cbe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1405 microversion: 2.20 time: 0.168758 Jul 31 18:41:16.224458 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 276/533] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:41:16 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:41:16.878819 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-2673f494-732e-481c-88ba-6ccc4203ba7c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:16.880126 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-2673f494-732e-481c-88ba-6ccc4203ba7c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:16.887366 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2673f494-732e-481c-88ba-6ccc4203ba7c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:16.887872 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2673f494-732e-481c-88ba-6ccc4203ba7c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:16.888835 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2673f494-732e-481c-88ba-6ccc4203ba7c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:16.889171 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2673f494-732e-481c-88ba-6ccc4203ba7c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:17.064816 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-2673f494-732e-481c-88ba-6ccc4203ba7c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:17.072895 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-2673f494-732e-481c-88ba-6ccc4203ba7c tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1725 microversion: 2.1 time: 0.198398 Jul 31 18:41:17.073614 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 258/534] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:16 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:17.247603 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4d8bc143-9c66-4554-baa1-97bb5a841db7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:17.248211 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-4d8bc143-9c66-4554-baa1-97bb5a841db7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:17.255646 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4d8bc143-9c66-4554-baa1-97bb5a841db7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:17.256065 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4d8bc143-9c66-4554-baa1-97bb5a841db7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:17.256857 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4d8bc143-9c66-4554-baa1-97bb5a841db7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:17.257293 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4d8bc143-9c66-4554-baa1-97bb5a841db7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:17.405510 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-4d8bc143-9c66-4554-baa1-97bb5a841db7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:17.421760 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-4d8bc143-9c66-4554-baa1-97bb5a841db7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:17.424079 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-4d8bc143-9c66-4554-baa1-97bb5a841db7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:17.425804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-4d8bc143-9c66-4554-baa1-97bb5a841db7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1405 microversion: 2.20 time: 0.182110 Jul 31 18:41:17.426574 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 277/535] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:41:17 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:41:18.106178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-ff206b49-1abb-4052-8079-919f94810713 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:18.107114 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-ff206b49-1abb-4052-8079-919f94810713 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:18.117371 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ff206b49-1abb-4052-8079-919f94810713 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:18.118151 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ff206b49-1abb-4052-8079-919f94810713 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:18.119402 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ff206b49-1abb-4052-8079-919f94810713 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:18.120150 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ff206b49-1abb-4052-8079-919f94810713 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:18.270432 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-ff206b49-1abb-4052-8079-919f94810713 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:18.278753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-ff206b49-1abb-4052-8079-919f94810713 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1731 microversion: 2.1 time: 0.179190 Jul 31 18:41:18.279312 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 259/536] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:18 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:18.299646 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-e2adc0ed-57b9-40b9-b9c9-ecddd1b676c2 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:18.300174 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-e2adc0ed-57b9-40b9-b9c9-ecddd1b676c2 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:18.307088 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e2adc0ed-57b9-40b9-b9c9-ecddd1b676c2 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:18.307531 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e2adc0ed-57b9-40b9-b9c9-ecddd1b676c2 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:18.308283 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e2adc0ed-57b9-40b9-b9c9-ecddd1b676c2 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:18.308820 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e2adc0ed-57b9-40b9-b9c9-ecddd1b676c2 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:18.391578 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-e2adc0ed-57b9-40b9-b9c9-ecddd1b676c2 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095743 Jul 31 18:41:18.392167 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 278/537] 10.222.0.49 () {58 vars in 1275 bytes} [Sun Jul 31 18:41:18 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:41:18.449873 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-5c68c554-abe2-4dc9-89d6-3b60b619e06f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:18.450602 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-5c68c554-abe2-4dc9-89d6-3b60b619e06f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:18.456961 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5c68c554-abe2-4dc9-89d6-3b60b619e06f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:18.457463 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5c68c554-abe2-4dc9-89d6-3b60b619e06f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:18.458224 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5c68c554-abe2-4dc9-89d6-3b60b619e06f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:18.458650 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5c68c554-abe2-4dc9-89d6-3b60b619e06f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:18.589353 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-5c68c554-abe2-4dc9-89d6-3b60b619e06f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:18.597632 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-5c68c554-abe2-4dc9-89d6-3b60b619e06f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:18.599136 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-5c68c554-abe2-4dc9-89d6-3b60b619e06f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:18.600239 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-5c68c554-abe2-4dc9-89d6-3b60b619e06f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1405 microversion: 2.20 time: 0.154478 Jul 31 18:41:18.600831 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 260/538] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:41:18 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:41:19.497582 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-5409f290-fd53-4059-a7c3-b22de6c820f2 req-d523b7f2-e5ed-4491-a889-60db0537b38d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4377ead1-89c3-4e21-b45c-c20dcf7bacf9", "tag": "4200cac4-2be0-4499-a408-eff0761571a8"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:41:19.508638 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-5409f290-fd53-4059-a7c3-b22de6c820f2 req-d523b7f2-e5ed-4491-a889-60db0537b38d service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:19.509370 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-5409f290-fd53-4059-a7c3-b22de6c820f2 req-d523b7f2-e5ed-4491-a889-60db0537b38d service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:19.521716 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-5409f290-fd53-4059-a7c3-b22de6c820f2 req-d523b7f2-e5ed-4491-a889-60db0537b38d service nova] Creating event network-changed:4200cac4-2be0-4499-a408-eff0761571a8 for instance 4377ead1-89c3-4e21-b45c-c20dcf7bacf9 on hv-cinder-84984 Jul 31 18:41:19.527654 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-5409f290-fd53-4059-a7c3-b22de6c820f2 req-d523b7f2-e5ed-4491-a889-60db0537b38d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034277 Jul 31 18:41:19.528982 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 279/539] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:41:19.624086 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-402b2f69-ed3e-4e5a-a015-c3beda7f5a87 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:19.624845 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-402b2f69-ed3e-4e5a-a015-c3beda7f5a87 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:19.631697 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-402b2f69-ed3e-4e5a-a015-c3beda7f5a87 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:19.632213 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-402b2f69-ed3e-4e5a-a015-c3beda7f5a87 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:19.633114 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-402b2f69-ed3e-4e5a-a015-c3beda7f5a87 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:19.633714 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-402b2f69-ed3e-4e5a-a015-c3beda7f5a87 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:20.084690 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-402b2f69-ed3e-4e5a-a015-c3beda7f5a87 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:20.094753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-402b2f69-ed3e-4e5a-a015-c3beda7f5a87 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:20.097269 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-402b2f69-ed3e-4e5a-a015-c3beda7f5a87 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:20.098707 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-402b2f69-ed3e-4e5a-a015-c3beda7f5a87 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1405 microversion: 2.20 time: 0.479601 Jul 31 18:41:20.114174 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 261/540] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:41:19 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1405 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 18:41:21.125826 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-188ea799-c658-4e9e-8cbd-bf999441e7ca tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:21.126550 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-188ea799-c658-4e9e-8cbd-bf999441e7ca tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:21.133845 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-188ea799-c658-4e9e-8cbd-bf999441e7ca tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:21.134284 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-188ea799-c658-4e9e-8cbd-bf999441e7ca tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:21.135048 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-188ea799-c658-4e9e-8cbd-bf999441e7ca tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:21.135478 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-188ea799-c658-4e9e-8cbd-bf999441e7ca tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:21.289270 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-188ea799-c658-4e9e-8cbd-bf999441e7ca tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:21.299079 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-188ea799-c658-4e9e-8cbd-bf999441e7ca tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:21.300565 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-188ea799-c658-4e9e-8cbd-bf999441e7ca tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:21.301690 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-188ea799-c658-4e9e-8cbd-bf999441e7ca tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1405 microversion: 2.20 time: 0.180777 Jul 31 18:41:21.302266 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 280/541] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:41:21 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:41:21.548071 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-9977b8bf-621f-4699-b34a-8bfc3e72928a req-f4031155-2b26-4be7-a099-87284fe4a2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4377ead1-89c3-4e21-b45c-c20dcf7bacf9", "tag": "4200cac4-2be0-4499-a408-eff0761571a8"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:41:21.562034 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-9977b8bf-621f-4699-b34a-8bfc3e72928a req-f4031155-2b26-4be7-a099-87284fe4a2f8 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:21.562482 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-9977b8bf-621f-4699-b34a-8bfc3e72928a req-f4031155-2b26-4be7-a099-87284fe4a2f8 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:21.576437 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-9977b8bf-621f-4699-b34a-8bfc3e72928a req-f4031155-2b26-4be7-a099-87284fe4a2f8 service nova] Creating event network-changed:4200cac4-2be0-4499-a408-eff0761571a8 for instance 4377ead1-89c3-4e21-b45c-c20dcf7bacf9 on hv-cinder-84984 Jul 31 18:41:21.582604 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-9977b8bf-621f-4699-b34a-8bfc3e72928a req-f4031155-2b26-4be7-a099-87284fe4a2f8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038369 Jul 31 18:41:21.583306 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 262/542] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:41:22.164683 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-74337a00-4b21-4521-a215-c52806467f25 req-13defbc1-7f2e-452d-b0eb-1320535c6faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1da82e-1477-4392-a5db-0113b56cf487", "name": "network-vif-plugged", "status": "completed", "tag": "c4842848-d109-451e-bfa5-d8934595abaf"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:41:22.185191 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-74337a00-4b21-4521-a215-c52806467f25 req-13defbc1-7f2e-452d-b0eb-1320535c6faf service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:22.185645 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-74337a00-4b21-4521-a215-c52806467f25 req-13defbc1-7f2e-452d-b0eb-1320535c6faf service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:22.196401 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-74337a00-4b21-4521-a215-c52806467f25 req-13defbc1-7f2e-452d-b0eb-1320535c6faf service nova] Creating event network-vif-plugged:c4842848-d109-451e-bfa5-d8934595abaf for instance 8c1da82e-1477-4392-a5db-0113b56cf487 on hv-cinder-84984 Jul 31 18:41:22.201482 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-74337a00-4b21-4521-a215-c52806467f25 req-13defbc1-7f2e-452d-b0eb-1320535c6faf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042038 Jul 31 18:41:22.202143 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 281/543] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:41:22.325287 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-24c775bc-c99e-4578-bb30-6d586b65ef4c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:22.325966 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-24c775bc-c99e-4578-bb30-6d586b65ef4c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:22.332539 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-24c775bc-c99e-4578-bb30-6d586b65ef4c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:22.332994 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-24c775bc-c99e-4578-bb30-6d586b65ef4c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:22.333748 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-24c775bc-c99e-4578-bb30-6d586b65ef4c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:22.334173 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-24c775bc-c99e-4578-bb30-6d586b65ef4c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:22.354835 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell0:SELECT=2 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:41:22.384601 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell0:SELECT=10 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:41:22.506434 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-24c775bc-c99e-4578-bb30-6d586b65ef4c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:22.518365 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-24c775bc-c99e-4578-bb30-6d586b65ef4c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:22.520609 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-24c775bc-c99e-4578-bb30-6d586b65ef4c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:22.522184 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-24c775bc-c99e-4578-bb30-6d586b65ef4c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1405 microversion: 2.20 time: 0.201466 Jul 31 18:41:22.522950 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 263/544] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:41:22 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1405 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:41:23.545167 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell0:SELECT=2 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:41:23.552290 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-e883acc8-1aac-4127-b38e-34861e4758b4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:23.553489 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-e883acc8-1aac-4127-b38e-34861e4758b4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:23.563923 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e883acc8-1aac-4127-b38e-34861e4758b4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:23.564622 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e883acc8-1aac-4127-b38e-34861e4758b4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:23.565889 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e883acc8-1aac-4127-b38e-34861e4758b4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:23.566585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e883acc8-1aac-4127-b38e-34861e4758b4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:23.700641 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-e883acc8-1aac-4127-b38e-34861e4758b4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:23.708983 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-e883acc8-1aac-4127-b38e-34861e4758b4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:23.710487 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-e883acc8-1aac-4127-b38e-34861e4758b4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:23.711600 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-e883acc8-1aac-4127-b38e-34861e4758b4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1405 microversion: 2.20 time: 0.168412 Jul 31 18:41:23.712134 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 282/545] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:41:23 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:41:24.739869 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-70373ca7-6790-422c-8c5a-d240cbf54213 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:24.740936 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-70373ca7-6790-422c-8c5a-d240cbf54213 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:24.749636 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-70373ca7-6790-422c-8c5a-d240cbf54213 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:24.750071 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-70373ca7-6790-422c-8c5a-d240cbf54213 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:24.750853 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-70373ca7-6790-422c-8c5a-d240cbf54213 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:24.751276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-70373ca7-6790-422c-8c5a-d240cbf54213 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:24.888614 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-70373ca7-6790-422c-8c5a-d240cbf54213 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:24.896727 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-70373ca7-6790-422c-8c5a-d240cbf54213 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:24.898243 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-70373ca7-6790-422c-8c5a-d240cbf54213 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:24.899392 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-70373ca7-6790-422c-8c5a-d240cbf54213 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1597 microversion: 2.20 time: 0.166054 Jul 31 18:41:24.899918 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 264/546] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:41:24 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1597 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:41:24.921471 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-45d17d40-9c90-4e90-8c3a-1b026307b97f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:24.921975 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-45d17d40-9c90-4e90-8c3a-1b026307b97f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:24.928888 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-45d17d40-9c90-4e90-8c3a-1b026307b97f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:24.929334 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-45d17d40-9c90-4e90-8c3a-1b026307b97f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:24.930089 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-45d17d40-9c90-4e90-8c3a-1b026307b97f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:24.930516 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-45d17d40-9c90-4e90-8c3a-1b026307b97f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:25.011435 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-45d17d40-9c90-4e90-8c3a-1b026307b97f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093743 Jul 31 18:41:25.012030 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 283/547] 10.222.0.49 () {60 vars in 1316 bytes} [Sun Jul 31 18:41:24 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 18:41:25.959632 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-cb851a3b-0fc0-4118-a4fa-ac63e801bbd9 req-e3f059a6-9d43-4276-9f44-30ad0097df15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c1da82e-1477-4392-a5db-0113b56cf487", "tag": "c4842848-d109-451e-bfa5-d8934595abaf"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:41:25.969701 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-cb851a3b-0fc0-4118-a4fa-ac63e801bbd9 req-e3f059a6-9d43-4276-9f44-30ad0097df15 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:25.970238 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-cb851a3b-0fc0-4118-a4fa-ac63e801bbd9 req-e3f059a6-9d43-4276-9f44-30ad0097df15 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:25.982135 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-cb851a3b-0fc0-4118-a4fa-ac63e801bbd9 req-e3f059a6-9d43-4276-9f44-30ad0097df15 service nova] Creating event network-changed:c4842848-d109-451e-bfa5-d8934595abaf for instance 8c1da82e-1477-4392-a5db-0113b56cf487 on hv-cinder-84984 Jul 31 18:41:25.987488 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-cb851a3b-0fc0-4118-a4fa-ac63e801bbd9 req-e3f059a6-9d43-4276-9f44-30ad0097df15 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031458 Jul 31 18:41:25.988137 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 265/548] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:41:32.269340 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-192c2fac-5742-4a2c-bd52-d8d3a8e53263 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:32.271544 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-192c2fac-5742-4a2c-bd52-d8d3a8e53263 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:32.273497 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:41:32.279154 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-192c2fac-5742-4a2c-bd52-d8d3a8e53263 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:32.279598 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-192c2fac-5742-4a2c-bd52-d8d3a8e53263 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:32.280374 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-192c2fac-5742-4a2c-bd52-d8d3a8e53263 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:32.280797 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-192c2fac-5742-4a2c-bd52-d8d3a8e53263 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:32.305249 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=100 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:41:32.311200 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-192c2fac-5742-4a2c-bd52-d8d3a8e53263 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046558 Jul 31 18:41:32.311739 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 284/549] 10.222.0.49 () {58 vars in 1302 bytes} [Sun Jul 31 18:41:32 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 18:41:32.374654 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-ea14e4d5-3cf7-44cc-8e4a-4fb638b6842d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:32.375202 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-ea14e4d5-3cf7-44cc-8e4a-4fb638b6842d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:32.377240 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:41:32.383654 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ea14e4d5-3cf7-44cc-8e4a-4fb638b6842d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:32.384102 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ea14e4d5-3cf7-44cc-8e4a-4fb638b6842d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:32.384897 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ea14e4d5-3cf7-44cc-8e4a-4fb638b6842d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:32.385337 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ea14e4d5-3cf7-44cc-8e4a-4fb638b6842d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:32.410763 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-ea14e4d5-3cf7-44cc-8e4a-4fb638b6842d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Going to try to terminate instance {{(pid=124333) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 18:41:32.489268 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-ea14e4d5-3cf7-44cc-8e4a-4fb638b6842d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 204 len: 0 microversion: 2.1 time: 0.119267 Jul 31 18:41:32.489760 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 266/550] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:41:32 2022] DELETE /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 18:41:32.498206 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-feff6d8f-5dd8-4df2-b7a9-49c661f7bd95 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:32.498825 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-feff6d8f-5dd8-4df2-b7a9-49c661f7bd95 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:32.505534 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-feff6d8f-5dd8-4df2-b7a9-49c661f7bd95 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:32.505993 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-feff6d8f-5dd8-4df2-b7a9-49c661f7bd95 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:32.506811 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-feff6d8f-5dd8-4df2-b7a9-49c661f7bd95 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:32.507246 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-feff6d8f-5dd8-4df2-b7a9-49c661f7bd95 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:32.642661 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-feff6d8f-5dd8-4df2-b7a9-49c661f7bd95 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:32.651969 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-feff6d8f-5dd8-4df2-b7a9-49c661f7bd95 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1674 microversion: 2.1 time: 0.157389 Jul 31 18:41:32.652590 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 285/551] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:32 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:33.147880 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-19c201b7-afc0-4453-9e40-0f65b003bd9f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:33.148451 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-19c201b7-afc0-4453-9e40-0f65b003bd9f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:33.155189 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-19c201b7-afc0-4453-9e40-0f65b003bd9f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:33.155638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-19c201b7-afc0-4453-9e40-0f65b003bd9f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:33.156395 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-19c201b7-afc0-4453-9e40-0f65b003bd9f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:33.156855 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-19c201b7-afc0-4453-9e40-0f65b003bd9f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:33.180812 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-19c201b7-afc0-4453-9e40-0f65b003bd9f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47/ips" status: 200 len: 151 microversion: 2.1 time: 0.037229 Jul 31 18:41:33.181411 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 267/552] 10.222.0.49 () {58 vars in 1248 bytes} [Sun Jul 31 18:41:33 2022] GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:41:33.679862 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-21f5ea08-21f5-4070-8df7-df188c1be136 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:33.680949 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-21f5ea08-21f5-4070-8df7-df188c1be136 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:33.689257 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-21f5ea08-21f5-4070-8df7-df188c1be136 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:33.689700 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-21f5ea08-21f5-4070-8df7-df188c1be136 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:33.690575 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-21f5ea08-21f5-4070-8df7-df188c1be136 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:33.691012 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-21f5ea08-21f5-4070-8df7-df188c1be136 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:33.839634 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-21f5ea08-21f5-4070-8df7-df188c1be136 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:33.847598 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-21f5ea08-21f5-4070-8df7-df188c1be136 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1674 microversion: 2.1 time: 0.174411 Jul 31 18:41:33.848137 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 286/553] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:33 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:34.535602 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-c653d576-9b5e-480b-985c-2aca18da28a6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a454fe8-9cca-4a2e-94f5-5320f39be371"}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:41:34.537970 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-c653d576-9b5e-480b-985c-2aca18da28a6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:34.544736 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c653d576-9b5e-480b-985c-2aca18da28a6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:34.545213 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c653d576-9b5e-480b-985c-2aca18da28a6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:34.545978 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c653d576-9b5e-480b-985c-2aca18da28a6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:34.546409 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c653d576-9b5e-480b-985c-2aca18da28a6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:34.795868 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-c653d576-9b5e-480b-985c-2aca18da28a6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "POST /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264124 Jul 31 18:41:34.796670 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 268/554] 10.222.0.49 () {60 vars in 1323 bytes} [Sun Jul 31 18:41:34 2022] POST /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:41:34.868957 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-0641f783-e03b-4d3d-aae3-7bb7f48f9291 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:34.869574 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-0641f783-e03b-4d3d-aae3-7bb7f48f9291 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:34.876282 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0641f783-e03b-4d3d-aae3-7bb7f48f9291 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:34.877000 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0641f783-e03b-4d3d-aae3-7bb7f48f9291 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:34.878438 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0641f783-e03b-4d3d-aae3-7bb7f48f9291 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:34.879026 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0641f783-e03b-4d3d-aae3-7bb7f48f9291 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:35.014577 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-0641f783-e03b-4d3d-aae3-7bb7f48f9291 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:35.031251 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-0641f783-e03b-4d3d-aae3-7bb7f48f9291 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1674 microversion: 2.1 time: 0.166014 Jul 31 18:41:35.031783 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 287/555] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:34 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:41:35.592074 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-bf8e51f9-653f-42d3-b4ae-01a5d43ad5ed req-4cd418a7-33d9-42f7-b60b-f311c7f668e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1577f8a-0f79-4b82-9afa-85c86f07cf92", "name": "network-vif-deleted", "tag": "afbd6a66-843d-4087-b7a7-1be3dd6e4af4"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:41:35.604789 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-bf8e51f9-653f-42d3-b4ae-01a5d43ad5ed req-4cd418a7-33d9-42f7-b60b-f311c7f668e0 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:35.605260 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-bf8e51f9-653f-42d3-b4ae-01a5d43ad5ed req-4cd418a7-33d9-42f7-b60b-f311c7f668e0 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:35.617628 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-bf8e51f9-653f-42d3-b4ae-01a5d43ad5ed req-4cd418a7-33d9-42f7-b60b-f311c7f668e0 service nova] Creating event network-vif-deleted:afbd6a66-843d-4087-b7a7-1be3dd6e4af4 for instance a1577f8a-0f79-4b82-9afa-85c86f07cf92 on hv-cinder-84984 Jul 31 18:41:35.625532 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-bf8e51f9-653f-42d3-b4ae-01a5d43ad5ed req-4cd418a7-33d9-42f7-b60b-f311c7f668e0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037608 Jul 31 18:41:35.626311 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 269/556] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:41:36.051491 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-9c066993-926f-4e9b-aeef-4701163be955 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:36.052421 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-9c066993-926f-4e9b-aeef-4701163be955 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:36.059096 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9c066993-926f-4e9b-aeef-4701163be955 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:36.059543 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9c066993-926f-4e9b-aeef-4701163be955 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:36.060290 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9c066993-926f-4e9b-aeef-4701163be955 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:36.060720 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9c066993-926f-4e9b-aeef-4701163be955 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:36.096313 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9c066993-926f-4e9b-aeef-4701163be955 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:36.096796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9c066993-926f-4e9b-aeef-4701163be955 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:36.097230 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.objects.instance [None req-9c066993-926f-4e9b-aeef-4701163be955 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lazy-loading 'fault' on Instance uuid a1577f8a-0f79-4b82-9afa-85c86f07cf92 {{(pid=124334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:41:36.146390 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-9c066993-926f-4e9b-aeef-4701163be955 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:36.156277 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-9c066993-926f-4e9b-aeef-4701163be955 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 200 len: 1327 microversion: 2.1 time: 0.108338 Jul 31 18:41:36.157413 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 288/557] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:36 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 1327 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:37.178696 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-7c14eae5-ac30-4ec1-9124-93e480dbc5ed tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:37.180058 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-7c14eae5-ac30-4ec1-9124-93e480dbc5ed tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:37.187274 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7c14eae5-ac30-4ec1-9124-93e480dbc5ed tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:37.187723 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7c14eae5-ac30-4ec1-9124-93e480dbc5ed tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:37.188492 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7c14eae5-ac30-4ec1-9124-93e480dbc5ed tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:37.188975 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7c14eae5-ac30-4ec1-9124-93e480dbc5ed tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:37.202438 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-7c14eae5-ac30-4ec1-9124-93e480dbc5ed tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] HTTP exception thrown: Instance a1577f8a-0f79-4b82-9afa-85c86f07cf92 could not be found. Jul 31 18:41:37.204035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-7c14eae5-ac30-4ec1-9124-93e480dbc5ed tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Request method failure captured: Jul 31 18:41:37.204035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 HTTP/1.1 Jul 31 18:41:37.204035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:41:37.204035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:41:37.204035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:41:37.204035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:41:37.204035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:41:37.204035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:41:37.204035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:41:37.204035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:41:37.204035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5svk5OD1ixXzGs7zky5gJpPAZfHtDEc9nf6moA_YRFWpu4h0oC7yspay74xaznK8IuBSFbxpAlC6ELtoYuYOlxb0nJAJ82PIwjSrwAP-xYHcLkH8IRi6nU_YxNycqlZiVZGdMV8m7zBmGAtl6vsCegoLpuEx28hRlP9EB6Ryyv9nVyY Jul 31 18:41:37.204035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:41:37.204035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:41:37.204035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:41:37.204035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:41:37.204035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:41:37.204035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:41:37.204035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: fc4113d291354d99b2591289639ec248 Jul 31 18:41:37.204035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-AttachVolumeTestJSON-2009046575 Jul 31 18:41:37.204035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:41:37.204035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:41:37.205584 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc4113d291354d99b2591289639ec248"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fc4113d291354d99b2591289639ec248", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fc4113d291354d99b2591289639ec248"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc4113d291354d99b2591289639ec248"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:41:37.205584 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-AttachVolumeTestJSON-2009046575 Jul 31 18:41:37.205584 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: fc4113d291354d99b2591289639ec248 Jul 31 18:41:37.205584 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2009046575 Jul 31 18:41:37.205584 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-AttachVolumeTestJSON-2009046575-project Jul 31 18:41:37.205584 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:41:37.205584 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:41:37.205584 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 4dc88d9b0bc743119dcb7dc2fa8fdcd6 Jul 31 18:41:37.205584 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-AttachVolumeTestJSON-2009046575-project Jul 31 18:41:37.205584 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: > Jul 31 18:41:37.205584 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Instance a1577f8a-0f79-4b82-9afa-85c86f07cf92 could not be found. Jul 31 18:41:37.205584 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': 'a1577f8a-0f79-4b82-9afa-85c86f07cf92'} Jul 31 18:41:37.206693 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:41:37.206693 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:41:37.206693 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:41:37.206693 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:41:37.206693 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:41:37.206693 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:41:37.206693 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:41:37.206693 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:41:37.206693 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:41:37.206693 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:41:37.206693 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1577f8a-0f79-4b82-9afa-85c86f07cf92 could not be found. Jul 31 18:41:37.206693 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:41:37.206693 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:41:37.206693 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:41:37.206693 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:41:37.206693 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:41:37.206693 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:41:37.206693 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:41:37.206693 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:41:37.206693 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:41:37.208144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:41:37.208144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:41:37.208144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:41:37.208144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:41:37.208144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:41:37.208144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:41:37.208144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:41:37.208144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1577f8a-0f79-4b82-9afa-85c86f07cf92 could not be found. Jul 31 18:41:37.208144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:41:37.208144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:41:37.208144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:41:37.208144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:41:37.208144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:41:37.208144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:41:37.208144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:41:37.208144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:41:37.208144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1577f8a-0f79-4b82-9afa-85c86f07cf92 could not be found. Jul 31 18:41:37.208144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:41:37.209560 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-7c14eae5-ac30-4ec1-9124-93e480dbc5ed tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Returning 404 to user: Instance a1577f8a-0f79-4b82-9afa-85c86f07cf92 could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:41:37.209560 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-7c14eae5-ac30-4ec1-9124-93e480dbc5ed tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 404 len: 111 microversion: 2.1 time: 0.031013 Jul 31 18:41:37.209560 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 270/558] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:37 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:41:37.214616 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-49467b62-6d0b-430b-a414-fdf19e285a04 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '.version_select at 0x7f87097f29d0>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:37.236104 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-49467b62-6d0b-430b-a414-fdf19e285a04 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306665566" status: 202 len: 0 microversion: 2.1 time: 0.025340 Jul 31 18:41:37.236683 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 289/559] 10.222.0.49 () {58 vars in 1221 bytes} [Sun Jul 31 18:41:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306665566 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:41:37.887483 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-4e05a1a4-d533-491b-a240-a02b0ec28aea tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Action: 'create', calling method: .version_select at 0x7f870a1ad3a0>, body: {"keypair": {"name": "tempest-keypair-155337625", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBG/6ngWSkTKwsasDJxtxr5aWWO96j8uaLWJ2I2HeDL1+THxt1rKjxHg+FQ5O2mCj+6yx/BdtaPo6CCcP5ejvo1HgPSwC3PuqRO/t2lJEnregqcRi+0lcIdk6wlDwHXgg=="}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:41:37.904155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-4e05a1a4-d533-491b-a240-a02b0ec28aea tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Getting quotas for project fc4113d291354d99b2591289639ec248. Resources: {'key_pairs'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:41:37.908072 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-4e05a1a4-d533-491b-a240-a02b0ec28aea tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Getting quotas for user 4dc88d9b0bc743119dcb7dc2fa8fdcd6 and project fc4113d291354d99b2591289639ec248. Resources: {'key_pairs'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:41:37.931304 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-4e05a1a4-d533-491b-a240-a02b0ec28aea tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047957 Jul 31 18:41:37.931942 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 271/560] 10.222.0.49 () {60 vars in 1159 bytes} [Sun Jul 31 18:41:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:41:39.246993 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-95aa9dfc-c8bd-46df-bfc9-3d1fadda2054 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-629113088", "imageRef": "6f2a0bb6-2fb3-4536-bee3-23e4e975f079", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5aeb6c21-a6d3-4ca0-97dc-7cf6239b2c5d"}], "security_groups": [{"name": "tempest-securitygroup--1807809069"}], "key_name": "tempest-keypair-155337625", "user_data": "}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:41:39.353090 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.network.neutron [None req-95aa9dfc-c8bd-46df-bfc9-3d1fadda2054 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] validate_networks() for [('5aeb6c21-a6d3-4ca0-97dc-7cf6239b2c5d', None, None, None, None, None)] {{(pid=124334) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 18:41:39.739249 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-95aa9dfc-c8bd-46df-bfc9-3d1fadda2054 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Flavor limits 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 18:41:39.739663 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-95aa9dfc-c8bd-46df-bfc9-3d1fadda2054 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Image limits 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 18:41:39.740129 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-95aa9dfc-c8bd-46df-bfc9-3d1fadda2054 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Flavor pref 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 18:41:39.740528 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-95aa9dfc-c8bd-46df-bfc9-3d1fadda2054 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Image pref 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 18:41:39.740960 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-95aa9dfc-c8bd-46df-bfc9-3d1fadda2054 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 18:41:39.751050 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-95aa9dfc-c8bd-46df-bfc9-3d1fadda2054 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:39.751488 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-95aa9dfc-c8bd-46df-bfc9-3d1fadda2054 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:39.752270 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-95aa9dfc-c8bd-46df-bfc9-3d1fadda2054 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:39.752697 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-95aa9dfc-c8bd-46df-bfc9-3d1fadda2054 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:39.770885 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.quota [None req-95aa9dfc-c8bd-46df-bfc9-3d1fadda2054 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Getting quotas for project fc4113d291354d99b2591289639ec248. Resources: {'cores', 'ram', 'instances'} {{(pid=124334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:41:39.775274 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.quota [None req-95aa9dfc-c8bd-46df-bfc9-3d1fadda2054 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Getting quotas for user 4dc88d9b0bc743119dcb7dc2fa8fdcd6 and project fc4113d291354d99b2591289639ec248. Resources: {'cores', 'ram', 'instances'} {{(pid=124334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:41:39.788076 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-95aa9dfc-c8bd-46df-bfc9-3d1fadda2054 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Going to run 1 instances... {{(pid=124334) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 18:41:39.790351 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-95aa9dfc-c8bd-46df-bfc9-3d1fadda2054 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f2a0bb6-2fb3-4536-bee3-23e4e975f079',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 18:41:39.837334 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-95aa9dfc-c8bd-46df-bfc9-3d1fadda2054 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.595013 Jul 31 18:41:39.837975 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 290/561] 10.222.0.49 () {60 vars in 1147 bytes} [Sun Jul 31 18:41:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 18:41:39.850250 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-7fbc9e18-953d-4b05-9fa0-dabd3b85e4ad tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:39.850856 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-7fbc9e18-953d-4b05-9fa0-dabd3b85e4ad tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:39.907732 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-7fbc9e18-953d-4b05-9fa0-dabd3b85e4ad tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:39.915724 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-7fbc9e18-953d-4b05-9fa0-dabd3b85e4ad tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725" status: 200 len: 1236 microversion: 2.1 time: 0.070643 Jul 31 18:41:39.916351 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 272/562] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:39 2022] GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725 => generated 1236 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:41:40.939099 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f37f7f36-de4a-4353-94d6-04b20a7c523e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:40.939905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-f37f7f36-de4a-4353-94d6-04b20a7c523e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:40.948645 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f37f7f36-de4a-4353-94d6-04b20a7c523e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:40.949273 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f37f7f36-de4a-4353-94d6-04b20a7c523e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:40.950261 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f37f7f36-de4a-4353-94d6-04b20a7c523e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:40.950827 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f37f7f36-de4a-4353-94d6-04b20a7c523e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:41.016200 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-f37f7f36-de4a-4353-94d6-04b20a7c523e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:41.027828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-f37f7f36-de4a-4353-94d6-04b20a7c523e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725" status: 200 len: 1288 microversion: 2.1 time: 0.093656 Jul 31 18:41:41.028562 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 291/563] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:40 2022] GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725 => generated 1288 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:42.050286 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-285f7e73-6980-42f0-9915-b41f9caf532f tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:42.050908 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-285f7e73-6980-42f0-9915-b41f9caf532f tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:42.057414 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-285f7e73-6980-42f0-9915-b41f9caf532f tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:42.057856 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-285f7e73-6980-42f0-9915-b41f9caf532f tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:42.058640 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-285f7e73-6980-42f0-9915-b41f9caf532f tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:42.059079 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-285f7e73-6980-42f0-9915-b41f9caf532f tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:42.062066 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:41:42.206594 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-285f7e73-6980-42f0-9915-b41f9caf532f tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:42.214338 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-285f7e73-6980-42f0-9915-b41f9caf532f tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725" status: 200 len: 1294 microversion: 2.1 time: 0.168073 Jul 31 18:41:42.214923 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 273/564] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:42 2022] GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725 => generated 1294 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:42.360154 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-6751b188-717b-4e6f-a563-28cd351d5e55 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a454fe8-9cca-4a2e-94f5-5320f39be371"}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:41:42.363003 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-6751b188-717b-4e6f-a563-28cd351d5e55 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:42.369916 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6751b188-717b-4e6f-a563-28cd351d5e55 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:42.370354 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6751b188-717b-4e6f-a563-28cd351d5e55 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:42.371141 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6751b188-717b-4e6f-a563-28cd351d5e55 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:42.371563 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6751b188-717b-4e6f-a563-28cd351d5e55 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:42.450650 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-6751b188-717b-4e6f-a563-28cd351d5e55 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] HTTP exception thrown: Invalid volume: volume 5a454fe8-9cca-4a2e-94f5-5320f39be371 is already attached to instances: 41338c87-271c-46dc-ba86-88a04da9ac47 Jul 31 18:41:42.452315 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-6751b188-717b-4e6f-a563-28cd351d5e55 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Request method failure captured: Jul 31 18:41:42.452315 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: POST /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47/os-volume_attachments HTTP/1.1 Jul 31 18:41:42.452315 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:41:42.452315 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:41:42.452315 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:41:42.452315 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 74 Jul 31 18:41:42.452315 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:41:42.452315 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:41:42.452315 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:41:42.452315 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:41:42.452315 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5svnCPQZeHt0IA40T23IJBlzfc_owbnP881pQWMpE8r05p0cjUmhFB7PWffkD-KRucC_Oyk8QutMV685S7HEr035rVpk89oU9HKa-wvvs-R5fBFQ0CQNEwRf6FMeK1W7edVvwFPexKLrlNGEN1GAEFVnFuiP_-qiW1e52QM8MwBKeEc Jul 31 18:41:42.452315 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:41:42.452315 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:41:42.452315 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:41:42.452315 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:41:42.452315 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:41:42.452315 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:41:42.452315 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:41:42.452315 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:41:42.452315 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:41:42.452315 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:41:42.453828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8b2df629457c4ff68ad061eb29cb232f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:41:42.453828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:41:42.453828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:41:42.453828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:41:42.453828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:41:42.453828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:41:42.453828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:41:42.453828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: 88472fa130654657af599106c6aac279 Jul 31 18:41:42.453828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:41:42.453828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Jul 31 18:41:42.453828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {"volumeAttachment": {"volumeId": "5a454fe8-9cca-4a2e-94f5-5320f39be371"}} Jul 31 18:41:42.453828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: > Jul 31 18:41:42.454828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Invalid volume: volume 5a454fe8-9cca-4a2e-94f5-5320f39be371 is already attached to instances: 41338c87-271c-46dc-ba86-88a04da9ac47 Jul 31 18:41:42.454828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'server_id': '41338c87-271c-46dc-ba86-88a04da9ac47', 'body': {'volumeAttachment': {'volumeId': '5a454fe8-9cca-4a2e-94f5-5320f39be371'}}} Jul 31 18:41:42.454828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:41:42.454828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:41:42.454828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 31 18:41:42.454828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 31 18:41:42.454828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 18:41:42.454828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 18:41:42.454828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 31 18:41:42.454828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 18:41:42.454828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 31 18:41:42.454828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 31 18:41:42.454828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 31 18:41:42.454828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 31 18:41:42.454828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5a454fe8-9cca-4a2e-94f5-5320f39be371 is already attached to instances: 41338c87-271c-46dc-ba86-88a04da9ac47 Jul 31 18:41:42.454828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:41:42.454828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:41:42.454828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:41:42.454828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:41:42.455976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:41:42.455976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:41:42.455976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:41:42.455976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:41:42.455976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:41:42.455976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:41:42.455976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 18:41:42.455976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 18:41:42.455976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 18:41:42.455976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 18:41:42.455976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 18:41:42.455976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 18:41:42.455976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 31 18:41:42.455976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 31 18:41:42.455976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5a454fe8-9cca-4a2e-94f5-5320f39be371 is already attached to instances: 41338c87-271c-46dc-ba86-88a04da9ac47 Jul 31 18:41:42.455976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:41:42.455976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:41:42.455976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:41:42.455976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:41:42.455976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:41:42.457114 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:41:42.457114 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:41:42.457114 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:41:42.457114 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5a454fe8-9cca-4a2e-94f5-5320f39be371 is already attached to instances: 41338c87-271c-46dc-ba86-88a04da9ac47 Jul 31 18:41:42.457114 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:41:42.457114 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-6751b188-717b-4e6f-a563-28cd351d5e55 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Returning 400 to user: Invalid volume: volume 5a454fe8-9cca-4a2e-94f5-5320f39be371 is already attached to instances: 41338c87-271c-46dc-ba86-88a04da9ac47 {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:41:42.457114 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-6751b188-717b-4e6f-a563-28cd351d5e55 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "POST /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097964 Jul 31 18:41:42.457114 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 292/565] 10.222.0.49 () {60 vars in 1323 bytes} [Sun Jul 31 18:41:42 2022] POST /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 18:41:42.521815 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-331af3ba-6b97-4cc4-a1c3-6bbac9be9d7d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:42.522430 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-331af3ba-6b97-4cc4-a1c3-6bbac9be9d7d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:42.528723 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-331af3ba-6b97-4cc4-a1c3-6bbac9be9d7d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:42.529317 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-331af3ba-6b97-4cc4-a1c3-6bbac9be9d7d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:42.530151 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-331af3ba-6b97-4cc4-a1c3-6bbac9be9d7d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:42.530647 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-331af3ba-6b97-4cc4-a1c3-6bbac9be9d7d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:42.615903 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.objects.instance [None req-331af3ba-6b97-4cc4-a1c3-6bbac9be9d7d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lazy-loading 'services' on Instance uuid 41338c87-271c-46dc-ba86-88a04da9ac47 {{(pid=124333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:41:42.696836 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-331af3ba-6b97-4cc4-a1c3-6bbac9be9d7d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "DELETE /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47/os-volume_attachments/5a454fe8-9cca-4a2e-94f5-5320f39be371" status: 202 len: 0 microversion: 2.1 time: 0.178926 Jul 31 18:41:42.698081 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 274/566] 10.222.0.49 () {58 vars in 1416 bytes} [Sun Jul 31 18:41:42 2022] DELETE /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47/os-volume_attachments/5a454fe8-9cca-4a2e-94f5-5320f39be371 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:41:42.707905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-5948bc60-6921-44bc-a9bf-d54afeb70d87 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:42.710232 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-5948bc60-6921-44bc-a9bf-d54afeb70d87 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:42.717506 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5948bc60-6921-44bc-a9bf-d54afeb70d87 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:42.717995 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5948bc60-6921-44bc-a9bf-d54afeb70d87 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:42.718767 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5948bc60-6921-44bc-a9bf-d54afeb70d87 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:42.719551 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5948bc60-6921-44bc-a9bf-d54afeb70d87 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:42.762749 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-5948bc60-6921-44bc-a9bf-d54afeb70d87 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060317 Jul 31 18:41:42.763317 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 293/567] 10.222.0.49 () {58 vars in 1302 bytes} [Sun Jul 31 18:41:42 2022] GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:41:43.236253 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-7b3fd919-1598-40af-9c9e-ba9c845c6ea1 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:43.237162 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-7b3fd919-1598-40af-9c9e-ba9c845c6ea1 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:43.244215 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7b3fd919-1598-40af-9c9e-ba9c845c6ea1 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:43.244751 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7b3fd919-1598-40af-9c9e-ba9c845c6ea1 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:43.245622 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7b3fd919-1598-40af-9c9e-ba9c845c6ea1 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:43.246111 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7b3fd919-1598-40af-9c9e-ba9c845c6ea1 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:43.310875 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-f3e4ea83-3294-422c-8890-bfb317e798fd req-9a60ed82-b413-462c-a502-a292999034b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab4406f9-3520-44ee-97e5-a8e771410725", "tag": "bbec5fa0-b83a-4ba1-8489-baa07b7934ef"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:41:43.324809 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-f3e4ea83-3294-422c-8890-bfb317e798fd req-9a60ed82-b413-462c-a502-a292999034b7 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:43.325113 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-f3e4ea83-3294-422c-8890-bfb317e798fd req-9a60ed82-b413-462c-a502-a292999034b7 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:43.338001 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-f3e4ea83-3294-422c-8890-bfb317e798fd req-9a60ed82-b413-462c-a502-a292999034b7 service nova] Creating event network-changed:bbec5fa0-b83a-4ba1-8489-baa07b7934ef for instance ab4406f9-3520-44ee-97e5-a8e771410725 on hv-cinder-84984 Jul 31 18:41:43.342866 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-f3e4ea83-3294-422c-8890-bfb317e798fd req-9a60ed82-b413-462c-a502-a292999034b7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036538 Jul 31 18:41:43.343633 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 294/568] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:41:43.536875 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-7b3fd919-1598-40af-9c9e-ba9c845c6ea1 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:43.545914 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-7b3fd919-1598-40af-9c9e-ba9c845c6ea1 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725" status: 200 len: 1362 microversion: 2.1 time: 0.313868 Jul 31 18:41:43.546595 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 275/569] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:43 2022] GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725 => generated 1362 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:43.776706 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f026c39a-937b-4cfc-a305-975985c11a5c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:43.779110 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-f026c39a-937b-4cfc-a305-975985c11a5c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:43.786406 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f026c39a-937b-4cfc-a305-975985c11a5c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:43.786850 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f026c39a-937b-4cfc-a305-975985c11a5c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:43.787633 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f026c39a-937b-4cfc-a305-975985c11a5c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:43.788071 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f026c39a-937b-4cfc-a305-975985c11a5c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:43.821185 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-f026c39a-937b-4cfc-a305-975985c11a5c tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048383 Jul 31 18:41:43.821789 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 295/570] 10.222.0.49 () {58 vars in 1302 bytes} [Sun Jul 31 18:41:43 2022] GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 18:41:43.884499 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-c9702515-d4bf-4583-a3e2-82fe9d1039be tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:43.885251 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-c9702515-d4bf-4583-a3e2-82fe9d1039be tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:43.891805 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c9702515-d4bf-4583-a3e2-82fe9d1039be tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:43.892247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c9702515-d4bf-4583-a3e2-82fe9d1039be tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:43.893080 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c9702515-d4bf-4583-a3e2-82fe9d1039be tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:43.893476 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c9702515-d4bf-4583-a3e2-82fe9d1039be tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:43.919058 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-c9702515-d4bf-4583-a3e2-82fe9d1039be tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] Going to try to terminate instance {{(pid=124333) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 18:41:43.994773 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-c9702515-d4bf-4583-a3e2-82fe9d1039be tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "DELETE /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47" status: 204 len: 0 microversion: 2.1 time: 0.116530 Jul 31 18:41:43.995348 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 276/571] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:41:43 2022] DELETE /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 18:41:44.004173 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-6a0c6606-be36-404a-a45b-eaf448f1ee88 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:44.004863 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-6a0c6606-be36-404a-a45b-eaf448f1ee88 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:44.011257 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6a0c6606-be36-404a-a45b-eaf448f1ee88 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:44.011701 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6a0c6606-be36-404a-a45b-eaf448f1ee88 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:44.012452 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6a0c6606-be36-404a-a45b-eaf448f1ee88 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:44.012913 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6a0c6606-be36-404a-a45b-eaf448f1ee88 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:44.153498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-6a0c6606-be36-404a-a45b-eaf448f1ee88 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:44.161351 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-6a0c6606-be36-404a-a45b-eaf448f1ee88 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47" status: 200 len: 1683 microversion: 2.1 time: 0.161530 Jul 31 18:41:44.161915 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 296/572] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:43 2022] GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:41:44.572153 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-de8c181a-8644-46e5-9a02-831d2ca7cbeb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:44.573230 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-de8c181a-8644-46e5-9a02-831d2ca7cbeb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:44.582261 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-de8c181a-8644-46e5-9a02-831d2ca7cbeb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:44.582703 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-de8c181a-8644-46e5-9a02-831d2ca7cbeb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:44.583456 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-de8c181a-8644-46e5-9a02-831d2ca7cbeb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:44.583891 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-de8c181a-8644-46e5-9a02-831d2ca7cbeb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:44.723676 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-de8c181a-8644-46e5-9a02-831d2ca7cbeb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:44.731897 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-de8c181a-8644-46e5-9a02-831d2ca7cbeb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725" status: 200 len: 1362 microversion: 2.1 time: 0.167051 Jul 31 18:41:44.732462 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 277/573] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:44 2022] GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:45.186924 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-c12cef1c-eaaa-46a5-90c4-91c7da256a83 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:45.187901 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-c12cef1c-eaaa-46a5-90c4-91c7da256a83 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:45.199073 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c12cef1c-eaaa-46a5-90c4-91c7da256a83 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:45.199818 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c12cef1c-eaaa-46a5-90c4-91c7da256a83 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:45.201144 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c12cef1c-eaaa-46a5-90c4-91c7da256a83 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:45.201871 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c12cef1c-eaaa-46a5-90c4-91c7da256a83 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:45.333748 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-c12cef1c-eaaa-46a5-90c4-91c7da256a83 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:45.341670 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-c12cef1c-eaaa-46a5-90c4-91c7da256a83 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47" status: 200 len: 1683 microversion: 2.1 time: 0.161460 Jul 31 18:41:45.342229 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 297/574] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:45 2022] GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:45.755263 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-8dcf7bbe-90a6-4db8-ba3b-f82f278f117e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:45.755935 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-8dcf7bbe-90a6-4db8-ba3b-f82f278f117e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:45.763119 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8dcf7bbe-90a6-4db8-ba3b-f82f278f117e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:45.763584 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8dcf7bbe-90a6-4db8-ba3b-f82f278f117e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:45.764378 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8dcf7bbe-90a6-4db8-ba3b-f82f278f117e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:45.764864 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8dcf7bbe-90a6-4db8-ba3b-f82f278f117e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:45.900475 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-8dcf7bbe-90a6-4db8-ba3b-f82f278f117e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:45.908102 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-8dcf7bbe-90a6-4db8-ba3b-f82f278f117e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725" status: 200 len: 1362 microversion: 2.1 time: 0.157868 Jul 31 18:41:45.908691 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 278/575] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:45 2022] GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:46.363331 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-287db305-6d80-4c2d-897c-b3b26dfbd6d3 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:46.363951 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-287db305-6d80-4c2d-897c-b3b26dfbd6d3 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:46.370801 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-287db305-6d80-4c2d-897c-b3b26dfbd6d3 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:46.371247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-287db305-6d80-4c2d-897c-b3b26dfbd6d3 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:46.372009 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-287db305-6d80-4c2d-897c-b3b26dfbd6d3 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:46.372440 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-287db305-6d80-4c2d-897c-b3b26dfbd6d3 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:46.508103 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-287db305-6d80-4c2d-897c-b3b26dfbd6d3 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:46.515657 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-287db305-6d80-4c2d-897c-b3b26dfbd6d3 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47" status: 200 len: 1683 microversion: 2.1 time: 0.156445 Jul 31 18:41:46.516249 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 298/576] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:46 2022] GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:46.929339 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-567e83c0-1572-4806-8d68-0d5b9302619d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:46.930014 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-567e83c0-1572-4806-8d68-0d5b9302619d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:46.937056 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-567e83c0-1572-4806-8d68-0d5b9302619d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:46.937600 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-567e83c0-1572-4806-8d68-0d5b9302619d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:46.940475 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-567e83c0-1572-4806-8d68-0d5b9302619d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:46.940475 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-567e83c0-1572-4806-8d68-0d5b9302619d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:47.170136 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-567e83c0-1572-4806-8d68-0d5b9302619d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:47.178573 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-567e83c0-1572-4806-8d68-0d5b9302619d tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725" status: 200 len: 1362 microversion: 2.1 time: 0.253196 Jul 31 18:41:47.179522 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 279/577] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:46 2022] GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725 => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:47.537649 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-8e17037c-3f8c-4859-9a48-c3a1f0e1c863 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:47.538226 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-8e17037c-3f8c-4859-9a48-c3a1f0e1c863 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:47.545108 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8e17037c-3f8c-4859-9a48-c3a1f0e1c863 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:47.545556 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8e17037c-3f8c-4859-9a48-c3a1f0e1c863 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:47.546320 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8e17037c-3f8c-4859-9a48-c3a1f0e1c863 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:47.546754 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8e17037c-3f8c-4859-9a48-c3a1f0e1c863 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:47.609811 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-8e17037c-3f8c-4859-9a48-c3a1f0e1c863 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:47.620661 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-8e17037c-3f8c-4859-9a48-c3a1f0e1c863 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47" status: 200 len: 1615 microversion: 2.1 time: 0.087006 Jul 31 18:41:47.621252 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-7f213e73-c67b-4158-bb70-213e42c42771 req-3fba8f71-6489-4d20-a184-15a0b5a53418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41338c87-271c-46dc-ba86-88a04da9ac47", "name": "network-vif-deleted", "tag": "ca14d319-eb18-44b3-b9de-6ac9f3d7a10f"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:41:47.621976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 299/578] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:47 2022] GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47 => generated 1615 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:47.632739 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-7f213e73-c67b-4158-bb70-213e42c42771 req-3fba8f71-6489-4d20-a184-15a0b5a53418 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:47.633234 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-7f213e73-c67b-4158-bb70-213e42c42771 req-3fba8f71-6489-4d20-a184-15a0b5a53418 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:47.644452 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-7f213e73-c67b-4158-bb70-213e42c42771 req-3fba8f71-6489-4d20-a184-15a0b5a53418 service nova] Creating event network-vif-deleted:ca14d319-eb18-44b3-b9de-6ac9f3d7a10f for instance 41338c87-271c-46dc-ba86-88a04da9ac47 on hv-cinder-84984 Jul 31 18:41:47.649250 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-7f213e73-c67b-4158-bb70-213e42c42771 req-3fba8f71-6489-4d20-a184-15a0b5a53418 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031599 Jul 31 18:41:47.652646 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 280/579] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:41:48.201310 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-7850145c-9b97-45f5-8798-2a08bb079b3e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:48.201957 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-7850145c-9b97-45f5-8798-2a08bb079b3e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:48.208638 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7850145c-9b97-45f5-8798-2a08bb079b3e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:48.209094 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7850145c-9b97-45f5-8798-2a08bb079b3e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:48.210663 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7850145c-9b97-45f5-8798-2a08bb079b3e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:48.211315 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7850145c-9b97-45f5-8798-2a08bb079b3e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:48.306948 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-2c4997b5-a46b-45c4-8d42-c9d9d85eeff0 req-bc96a554-7fac-446b-b1f1-8e0149c4106f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab4406f9-3520-44ee-97e5-a8e771410725", "name": "network-vif-plugged", "status": "completed", "tag": "bbec5fa0-b83a-4ba1-8489-baa07b7934ef"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:41:48.318324 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-2c4997b5-a46b-45c4-8d42-c9d9d85eeff0 req-bc96a554-7fac-446b-b1f1-8e0149c4106f service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:48.319106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-2c4997b5-a46b-45c4-8d42-c9d9d85eeff0 req-bc96a554-7fac-446b-b1f1-8e0149c4106f service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:48.331395 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-2c4997b5-a46b-45c4-8d42-c9d9d85eeff0 req-bc96a554-7fac-446b-b1f1-8e0149c4106f service nova] Creating event network-vif-plugged:bbec5fa0-b83a-4ba1-8489-baa07b7934ef for instance ab4406f9-3520-44ee-97e5-a8e771410725 on hv-cinder-84984 Jul 31 18:41:48.336877 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-2c4997b5-a46b-45c4-8d42-c9d9d85eeff0 req-bc96a554-7fac-446b-b1f1-8e0149c4106f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034739 Jul 31 18:41:48.338059 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 281/580] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:41:48.365260 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-7850145c-9b97-45f5-8798-2a08bb079b3e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:48.373242 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-7850145c-9b97-45f5-8798-2a08bb079b3e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725" status: 200 len: 1362 microversion: 2.1 time: 0.176414 Jul 31 18:41:48.375285 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 300/581] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:48 2022] GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:48.644214 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-ebf7b02a-0f21-48ea-8183-8dd6e9510e86 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:48.644951 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-ebf7b02a-0f21-48ea-8183-8dd6e9510e86 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:48.651307 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ebf7b02a-0f21-48ea-8183-8dd6e9510e86 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:48.651745 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ebf7b02a-0f21-48ea-8183-8dd6e9510e86 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:48.652496 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ebf7b02a-0f21-48ea-8183-8dd6e9510e86 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:48.652960 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ebf7b02a-0f21-48ea-8183-8dd6e9510e86 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:48.669103 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-ebf7b02a-0f21-48ea-8183-8dd6e9510e86 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] HTTP exception thrown: Instance 41338c87-271c-46dc-ba86-88a04da9ac47 could not be found. Jul 31 18:41:48.670791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-ebf7b02a-0f21-48ea-8183-8dd6e9510e86 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Request method failure captured: Jul 31 18:41:48.670791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47 HTTP/1.1 Jul 31 18:41:48.670791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:41:48.670791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:41:48.670791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:41:48.670791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:41:48.670791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:41:48.670791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:41:48.670791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:41:48.670791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:41:48.670791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5svnCPQZeHt0IA40T23IJBlzfc_owbnP881pQWMpE8r05p0cjUmhFB7PWffkD-KRucC_Oyk8QutMV685S7HEr035rVpk89oU9HKa-wvvs-R5fBFQ0CQNEwRf6FMeK1W7edVvwFPexKLrlNGEN1GAEFVnFuiP_-qiW1e52QM8MwBKeEc Jul 31 18:41:48.670791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:41:48.670791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:41:48.670791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:41:48.670791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:41:48.670791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:41:48.670791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:41:48.670791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:41:48.670791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:41:48.670791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:41:48.670791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:41:48.672136 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8b2df629457c4ff68ad061eb29cb232f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:41:48.672136 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:41:48.672136 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:41:48.672136 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:41:48.672136 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:41:48.672136 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:41:48.672136 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:41:48.672136 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 88472fa130654657af599106c6aac279 Jul 31 18:41:48.672136 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:41:48.672136 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: > Jul 31 18:41:48.672136 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Instance 41338c87-271c-46dc-ba86-88a04da9ac47 could not be found. Jul 31 18:41:48.672136 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': '41338c87-271c-46dc-ba86-88a04da9ac47'} Jul 31 18:41:48.672900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:41:48.672900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:41:48.672900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:41:48.672900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:41:48.672900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:41:48.672900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:41:48.672900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:41:48.672900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:41:48.672900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:41:48.672900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:41:48.672900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41338c87-271c-46dc-ba86-88a04da9ac47 could not be found. Jul 31 18:41:48.672900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:41:48.672900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:41:48.672900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:41:48.672900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:41:48.672900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:41:48.672900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:41:48.672900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:41:48.672900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:41:48.672900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:41:48.674273 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:41:48.674273 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:41:48.674273 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:41:48.674273 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:41:48.674273 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:41:48.674273 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:41:48.674273 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:41:48.674273 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41338c87-271c-46dc-ba86-88a04da9ac47 could not be found. Jul 31 18:41:48.674273 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:41:48.674273 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:41:48.674273 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:41:48.674273 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:41:48.674273 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:41:48.674273 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:41:48.674273 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:41:48.674273 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:41:48.674273 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41338c87-271c-46dc-ba86-88a04da9ac47 could not be found. Jul 31 18:41:48.674273 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:41:48.675518 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-ebf7b02a-0f21-48ea-8183-8dd6e9510e86 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Returning 404 to user: Instance 41338c87-271c-46dc-ba86-88a04da9ac47 could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:41:48.675518 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-ebf7b02a-0f21-48ea-8183-8dd6e9510e86 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47" status: 404 len: 111 microversion: 2.1 time: 0.032281 Jul 31 18:41:48.675518 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 282/582] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:48 2022] GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:41:48.682338 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-70f6e93b-3b06-4862-a046-a46c9ab0f2aa tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '.version_select at 0x7f870983c820>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:48.702959 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-70f6e93b-3b06-4862-a046-a46c9ab0f2aa tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-613123085" status: 202 len: 0 microversion: 2.1 time: 0.025204 Jul 31 18:41:48.703545 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 301/583] 10.222.0.49 () {58 vars in 1218 bytes} [Sun Jul 31 18:41:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-613123085 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:41:49.337457 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-5cb34380-c723-499c-a531-16492246eab4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Action: 'create', calling method: .version_select at 0x7f870a075310>, body: {"keypair": {"name": "tempest-keypair-1890480947", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPasWV5gPBssJsIVIG0hmLZRjN+IytXSC8ClVnYAxhwPsSeuxcrEtX3n5I16/u8YMEq5OtqEun48mi2M6FJgWEGny0va5ciyzvur0dedsu8JWCa1lFc/jBx2bsueL+ZrQ=="}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:41:49.354158 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-5cb34380-c723-499c-a531-16492246eab4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Getting quotas for project 8b2df629457c4ff68ad061eb29cb232f. Resources: {'key_pairs'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:41:49.358307 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-5cb34380-c723-499c-a531-16492246eab4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Getting quotas for user 88472fa130654657af599106c6aac279 and project 8b2df629457c4ff68ad061eb29cb232f. Resources: {'key_pairs'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:41:49.382867 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-5cb34380-c723-499c-a531-16492246eab4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049433 Jul 31 18:41:49.383649 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 283/584] 10.222.0.49 () {60 vars in 1159 bytes} [Sun Jul 31 18:41:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:41:49.393669 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-5b704999-07a4-41c1-ab94-a0d41b4170d1 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:49.394276 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-5b704999-07a4-41c1-ab94-a0d41b4170d1 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:49.401289 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5b704999-07a4-41c1-ab94-a0d41b4170d1 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:49.401739 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5b704999-07a4-41c1-ab94-a0d41b4170d1 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:49.402526 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5b704999-07a4-41c1-ab94-a0d41b4170d1 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:49.402952 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5b704999-07a4-41c1-ab94-a0d41b4170d1 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:49.536539 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-5b704999-07a4-41c1-ab94-a0d41b4170d1 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:49.544503 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-5b704999-07a4-41c1-ab94-a0d41b4170d1 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725" status: 200 len: 1362 microversion: 2.1 time: 0.154731 Jul 31 18:41:49.545445 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 302/585] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:49 2022] GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:50.566587 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-4f2fe648-93df-419e-bd5a-8358b5cf5ffb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:50.567167 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-4f2fe648-93df-419e-bd5a-8358b5cf5ffb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:50.575012 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4f2fe648-93df-419e-bd5a-8358b5cf5ffb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:50.575678 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4f2fe648-93df-419e-bd5a-8358b5cf5ffb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:50.576459 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4f2fe648-93df-419e-bd5a-8358b5cf5ffb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:50.576921 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4f2fe648-93df-419e-bd5a-8358b5cf5ffb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:50.677482 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-c939f57c-5f27-40c9-8a85-fc7074bc851a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1805695725", "imageRef": "6f2a0bb6-2fb3-4536-bee3-23e4e975f079", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf14a566-5800-492e-9819-b36a005e1f98"}], "security_groups": [{"name": "tempest-securitygroup--1544446917"}], "key_name": "tempest-keypair-1890480947", "user_data": "}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:41:50.689914 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell0:SELECT=2 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:41:50.690727 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell0:SELECT=6 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:41:50.717541 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-4f2fe648-93df-419e-bd5a-8358b5cf5ffb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:50.725447 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-4f2fe648-93df-419e-bd5a-8358b5cf5ffb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725" status: 200 len: 1547 microversion: 2.1 time: 0.162872 Jul 31 18:41:50.725999 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 284/586] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:50 2022] GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725 => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:50.745642 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-c92cde54-a5f6-4f75-aa37-94b022d8d303 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:50.746124 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-c92cde54-a5f6-4f75-aa37-94b022d8d303 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:50.752195 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c92cde54-a5f6-4f75-aa37-94b022d8d303 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:50.752640 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c92cde54-a5f6-4f75-aa37-94b022d8d303 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:50.753818 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c92cde54-a5f6-4f75-aa37-94b022d8d303 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:50.754247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c92cde54-a5f6-4f75-aa37-94b022d8d303 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:50.783477 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.network.neutron [None req-c939f57c-5f27-40c9-8a85-fc7074bc851a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] validate_networks() for [('cf14a566-5800-492e-9819-b36a005e1f98', None, None, None, None, None)] {{(pid=124334) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 18:41:50.833807 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-c92cde54-a5f6-4f75-aa37-94b022d8d303 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091913 Jul 31 18:41:50.834431 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 285/587] 10.222.0.49 () {58 vars in 1275 bytes} [Sun Jul 31 18:41:50 2022] GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:41:51.156424 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-c939f57c-5f27-40c9-8a85-fc7074bc851a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Flavor limits 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 18:41:51.156984 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-c939f57c-5f27-40c9-8a85-fc7074bc851a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Image limits 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 18:41:51.157543 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-c939f57c-5f27-40c9-8a85-fc7074bc851a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Flavor pref 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 18:41:51.157924 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-c939f57c-5f27-40c9-8a85-fc7074bc851a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Image pref 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 18:41:51.158687 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-c939f57c-5f27-40c9-8a85-fc7074bc851a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 18:41:51.169064 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c939f57c-5f27-40c9-8a85-fc7074bc851a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:51.169833 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c939f57c-5f27-40c9-8a85-fc7074bc851a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:51.170642 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c939f57c-5f27-40c9-8a85-fc7074bc851a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:51.171071 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c939f57c-5f27-40c9-8a85-fc7074bc851a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:51.189957 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.quota [None req-c939f57c-5f27-40c9-8a85-fc7074bc851a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Getting quotas for project 8b2df629457c4ff68ad061eb29cb232f. Resources: {'cores', 'ram', 'instances'} {{(pid=124334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:41:51.194441 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.quota [None req-c939f57c-5f27-40c9-8a85-fc7074bc851a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Getting quotas for user 88472fa130654657af599106c6aac279 and project 8b2df629457c4ff68ad061eb29cb232f. Resources: {'cores', 'ram', 'instances'} {{(pid=124334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:41:51.206473 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-c939f57c-5f27-40c9-8a85-fc7074bc851a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Going to run 1 instances... {{(pid=124334) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 18:41:51.208794 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-c939f57c-5f27-40c9-8a85-fc7074bc851a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f2a0bb6-2fb3-4536-bee3-23e4e975f079',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 18:41:51.259055 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-c939f57c-5f27-40c9-8a85-fc7074bc851a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.585909 Jul 31 18:41:51.265908 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 303/588] 10.222.0.49 () {60 vars in 1147 bytes} [Sun Jul 31 18:41:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 18:41:51.271332 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-3a937b61-7656-4df4-8363-1ba258a3f5f6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:51.272461 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-3a937b61-7656-4df4-8363-1ba258a3f5f6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:51.359521 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-3a937b61-7656-4df4-8363-1ba258a3f5f6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:51.368027 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-3a937b61-7656-4df4-8363-1ba258a3f5f6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345" status: 200 len: 1242 microversion: 2.1 time: 0.100379 Jul 31 18:41:51.382348 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 286/589] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:51 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345 => generated 1242 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:52.075925 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-1684ef26-6ea2-41b8-89b1-99ae507bb77d req-9146af28-80de-4234-9211-6b04123d5238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab4406f9-3520-44ee-97e5-a8e771410725", "tag": "bbec5fa0-b83a-4ba1-8489-baa07b7934ef"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:41:52.089183 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-1684ef26-6ea2-41b8-89b1-99ae507bb77d req-9146af28-80de-4234-9211-6b04123d5238 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:52.089626 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-1684ef26-6ea2-41b8-89b1-99ae507bb77d req-9146af28-80de-4234-9211-6b04123d5238 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:52.101293 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-1684ef26-6ea2-41b8-89b1-99ae507bb77d req-9146af28-80de-4234-9211-6b04123d5238 service nova] Creating event network-changed:bbec5fa0-b83a-4ba1-8489-baa07b7934ef for instance ab4406f9-3520-44ee-97e5-a8e771410725 on hv-cinder-84984 Jul 31 18:41:52.106549 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-1684ef26-6ea2-41b8-89b1-99ae507bb77d req-9146af28-80de-4234-9211-6b04123d5238 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034922 Jul 31 18:41:52.107211 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 304/590] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:41:52.388952 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-5f12af44-8343-4512-b079-1aa61169002b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:52.389712 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-5f12af44-8343-4512-b079-1aa61169002b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:52.396359 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5f12af44-8343-4512-b079-1aa61169002b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:52.396962 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5f12af44-8343-4512-b079-1aa61169002b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:52.397998 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5f12af44-8343-4512-b079-1aa61169002b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:52.398521 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5f12af44-8343-4512-b079-1aa61169002b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:52.510946 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-5f12af44-8343-4512-b079-1aa61169002b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:52.518966 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-5f12af44-8343-4512-b079-1aa61169002b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345" status: 200 len: 1300 microversion: 2.1 time: 0.133857 Jul 31 18:41:52.519605 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 287/591] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:52 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345 => generated 1300 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:53.543203 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-a8d0fe35-fa0a-487c-a9ab-28da579984ba tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:53.543961 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-a8d0fe35-fa0a-487c-a9ab-28da579984ba tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:53.550516 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a8d0fe35-fa0a-487c-a9ab-28da579984ba tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:53.550956 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a8d0fe35-fa0a-487c-a9ab-28da579984ba tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:53.551782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a8d0fe35-fa0a-487c-a9ab-28da579984ba tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:53.552191 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a8d0fe35-fa0a-487c-a9ab-28da579984ba tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:53.901964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-a8d0fe35-fa0a-487c-a9ab-28da579984ba tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:53.904372 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=100 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:41:53.911117 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-a8d0fe35-fa0a-487c-a9ab-28da579984ba tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345" status: 200 len: 1368 microversion: 2.1 time: 0.373683 Jul 31 18:41:53.911687 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 305/592] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:53 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345 => generated 1368 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:54.143341 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-bbf8c1d7-4c69-41cc-8735-2e79e8d82a77 req-6c1a96b0-7234-4125-9b7f-cc95dbd1b3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "393ca02e-2618-40a8-8764-5f039ebd3345", "tag": "85a54d1c-4356-47db-b52c-f53c6798c16e"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:41:54.153977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-bbf8c1d7-4c69-41cc-8735-2e79e8d82a77 req-6c1a96b0-7234-4125-9b7f-cc95dbd1b3a3 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:54.154413 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-bbf8c1d7-4c69-41cc-8735-2e79e8d82a77 req-6c1a96b0-7234-4125-9b7f-cc95dbd1b3a3 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:54.165781 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-bbf8c1d7-4c69-41cc-8735-2e79e8d82a77 req-6c1a96b0-7234-4125-9b7f-cc95dbd1b3a3 service nova] Creating event network-changed:85a54d1c-4356-47db-b52c-f53c6798c16e for instance 393ca02e-2618-40a8-8764-5f039ebd3345 on hv-cinder-84984 Jul 31 18:41:54.170834 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-bbf8c1d7-4c69-41cc-8735-2e79e8d82a77 req-6c1a96b0-7234-4125-9b7f-cc95dbd1b3a3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031285 Jul 31 18:41:54.171421 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 288/593] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:41:54.932379 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-977e43c2-d003-43e9-b304-5f990dd224f6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:54.933169 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-977e43c2-d003-43e9-b304-5f990dd224f6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:54.940100 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-977e43c2-d003-43e9-b304-5f990dd224f6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:54.940538 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-977e43c2-d003-43e9-b304-5f990dd224f6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:54.941333 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-977e43c2-d003-43e9-b304-5f990dd224f6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:54.941763 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-977e43c2-d003-43e9-b304-5f990dd224f6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:55.085428 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-977e43c2-d003-43e9-b304-5f990dd224f6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:55.093515 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-977e43c2-d003-43e9-b304-5f990dd224f6 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345" status: 200 len: 1368 microversion: 2.1 time: 0.165411 Jul 31 18:41:55.094093 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 306/594] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:54 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:56.120560 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-e1bb44c0-767e-4591-ba10-2641acef9ca2 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:56.121648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-e1bb44c0-767e-4591-ba10-2641acef9ca2 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:56.130281 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e1bb44c0-767e-4591-ba10-2641acef9ca2 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:56.130728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e1bb44c0-767e-4591-ba10-2641acef9ca2 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:56.131498 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e1bb44c0-767e-4591-ba10-2641acef9ca2 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:56.131933 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e1bb44c0-767e-4591-ba10-2641acef9ca2 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:56.267264 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-e1bb44c0-767e-4591-ba10-2641acef9ca2 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:56.274886 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-e1bb44c0-767e-4591-ba10-2641acef9ca2 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345" status: 200 len: 1368 microversion: 2.1 time: 0.162649 Jul 31 18:41:56.275453 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 289/595] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:56 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:57.300178 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-1737c5c3-340a-48cd-998c-4c42931ad50a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:57.301195 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-1737c5c3-340a-48cd-998c-4c42931ad50a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:57.312243 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1737c5c3-340a-48cd-998c-4c42931ad50a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:57.313062 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1737c5c3-340a-48cd-998c-4c42931ad50a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:57.314381 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1737c5c3-340a-48cd-998c-4c42931ad50a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:57.315102 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1737c5c3-340a-48cd-998c-4c42931ad50a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:57.393923 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-a567142e-10d0-47bb-b6ac-7a080183c984 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:57.394487 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-a567142e-10d0-47bb-b6ac-7a080183c984 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:57.401588 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a567142e-10d0-47bb-b6ac-7a080183c984 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:57.401711 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a567142e-10d0-47bb-b6ac-7a080183c984 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:57.402433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a567142e-10d0-47bb-b6ac-7a080183c984 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:57.402860 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a567142e-10d0-47bb-b6ac-7a080183c984 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:57.452524 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-1737c5c3-340a-48cd-998c-4c42931ad50a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:57.460851 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-1737c5c3-340a-48cd-998c-4c42931ad50a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345" status: 200 len: 1368 microversion: 2.1 time: 0.167228 Jul 31 18:41:57.461565 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 307/596] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:57 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:41:57.482796 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.objects.instance [None req-a567142e-10d0-47bb-b6ac-7a080183c984 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lazy-loading 'services' on Instance uuid 4377ead1-89c3-4e21-b45c-c20dcf7bacf9 {{(pid=124333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:41:57.554638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-a567142e-10d0-47bb-b6ac-7a080183c984 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9/os-volume_attachments/36041ea7-630c-4f4c-a382-f438ba81fab5" status: 202 len: 0 microversion: 2.1 time: 0.164668 Jul 31 18:41:57.555255 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 290/597] 10.222.0.49 () {58 vars in 1416 bytes} [Sun Jul 31 18:41:57 2022] DELETE /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9/os-volume_attachments/36041ea7-630c-4f4c-a382-f438ba81fab5 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:41:57.564753 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f1618900-3f2e-4044-a6b5-73baa7388f76 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:57.567044 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-f1618900-3f2e-4044-a6b5-73baa7388f76 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:57.574168 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f1618900-3f2e-4044-a6b5-73baa7388f76 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:57.574679 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f1618900-3f2e-4044-a6b5-73baa7388f76 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:57.575512 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f1618900-3f2e-4044-a6b5-73baa7388f76 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:57.576044 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f1618900-3f2e-4044-a6b5-73baa7388f76 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:57.607116 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-f1618900-3f2e-4044-a6b5-73baa7388f76 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046547 Jul 31 18:41:57.607674 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 308/598] 10.222.0.49 () {58 vars in 1302 bytes} [Sun Jul 31 18:41:57 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:41:58.349807 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-6d388997-4275-4bc2-9648-85489149f9c3 req-9b3e1184-5f6c-4f9f-bbd3-2bd2066bdae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "393ca02e-2618-40a8-8764-5f039ebd3345", "name": "network-vif-plugged", "status": "completed", "tag": "85a54d1c-4356-47db-b52c-f53c6798c16e"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:41:58.359711 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-6d388997-4275-4bc2-9648-85489149f9c3 req-9b3e1184-5f6c-4f9f-bbd3-2bd2066bdae8 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:58.360160 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-6d388997-4275-4bc2-9648-85489149f9c3 req-9b3e1184-5f6c-4f9f-bbd3-2bd2066bdae8 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:58.371024 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-6d388997-4275-4bc2-9648-85489149f9c3 req-9b3e1184-5f6c-4f9f-bbd3-2bd2066bdae8 service nova] Creating event network-vif-plugged:85a54d1c-4356-47db-b52c-f53c6798c16e for instance 393ca02e-2618-40a8-8764-5f039ebd3345 on hv-cinder-84984 Jul 31 18:41:58.375898 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-6d388997-4275-4bc2-9648-85489149f9c3 req-9b3e1184-5f6c-4f9f-bbd3-2bd2066bdae8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030076 Jul 31 18:41:58.376458 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 291/599] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:41:58.482180 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-af31c323-5f85-43ff-8258-c65dd0a47a45 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:58.482883 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-af31c323-5f85-43ff-8258-c65dd0a47a45 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:58.489942 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-af31c323-5f85-43ff-8258-c65dd0a47a45 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:58.490417 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-af31c323-5f85-43ff-8258-c65dd0a47a45 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:58.491191 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-af31c323-5f85-43ff-8258-c65dd0a47a45 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:58.491619 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-af31c323-5f85-43ff-8258-c65dd0a47a45 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:58.620390 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-71f80e0b-f52e-4fd4-ba37-2e21a2ff00cd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:58.622850 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-af31c323-5f85-43ff-8258-c65dd0a47a45 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:58.623293 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-71f80e0b-f52e-4fd4-ba37-2e21a2ff00cd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:58.630787 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-71f80e0b-f52e-4fd4-ba37-2e21a2ff00cd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:58.631445 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-af31c323-5f85-43ff-8258-c65dd0a47a45 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345" status: 200 len: 1368 microversion: 2.1 time: 0.153019 Jul 31 18:41:58.631581 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-71f80e0b-f52e-4fd4-ba37-2e21a2ff00cd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:58.632297 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 309/600] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:58 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:41:58.632440 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-71f80e0b-f52e-4fd4-ba37-2e21a2ff00cd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:58.633148 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-71f80e0b-f52e-4fd4-ba37-2e21a2ff00cd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:58.647731 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:41:58.665155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-71f80e0b-f52e-4fd4-ba37-2e21a2ff00cd tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049251 Jul 31 18:41:58.665707 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 292/601] 10.222.0.49 () {58 vars in 1302 bytes} [Sun Jul 31 18:41:58 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 31 18:41:58.747051 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-222621cd-db63-488b-8d8b-b0e009a83c1b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:58.747461 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-222621cd-db63-488b-8d8b-b0e009a83c1b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:58.754196 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-222621cd-db63-488b-8d8b-b0e009a83c1b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:58.754638 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-222621cd-db63-488b-8d8b-b0e009a83c1b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:58.755391 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-222621cd-db63-488b-8d8b-b0e009a83c1b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:58.755816 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-222621cd-db63-488b-8d8b-b0e009a83c1b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:58.780738 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-222621cd-db63-488b-8d8b-b0e009a83c1b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Going to try to terminate instance {{(pid=124334) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 18:41:58.878597 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-222621cd-db63-488b-8d8b-b0e009a83c1b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 204 len: 0 microversion: 2.1 time: 0.134721 Jul 31 18:41:58.879216 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 310/602] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:41:58 2022] DELETE /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 18:41:58.889755 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-fe456c07-9555-4b69-a88d-ba7f1a1ec12e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:58.890804 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-fe456c07-9555-4b69-a88d-ba7f1a1ec12e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:58.897465 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-fe456c07-9555-4b69-a88d-ba7f1a1ec12e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:58.897914 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-fe456c07-9555-4b69-a88d-ba7f1a1ec12e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:58.898670 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-fe456c07-9555-4b69-a88d-ba7f1a1ec12e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:58.899101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-fe456c07-9555-4b69-a88d-ba7f1a1ec12e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:59.033838 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-fe456c07-9555-4b69-a88d-ba7f1a1ec12e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:59.041764 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-fe456c07-9555-4b69-a88d-ba7f1a1ec12e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1691 microversion: 2.1 time: 0.158083 Jul 31 18:41:59.042332 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 293/603] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:58 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:41:59.657679 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-c12786a9-6960-49e0-8217-45f1d7717f62 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:41:59.658834 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-c12786a9-6960-49e0-8217-45f1d7717f62 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:41:59.670068 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c12786a9-6960-49e0-8217-45f1d7717f62 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:59.670707 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c12786a9-6960-49e0-8217-45f1d7717f62 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:59.671955 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c12786a9-6960-49e0-8217-45f1d7717f62 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:41:59.672660 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c12786a9-6960-49e0-8217-45f1d7717f62 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:41:59.820152 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-c12786a9-6960-49e0-8217-45f1d7717f62 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:41:59.831108 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-c12786a9-6960-49e0-8217-45f1d7717f62 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345" status: 200 len: 1368 microversion: 2.1 time: 0.180212 Jul 31 18:41:59.831896 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 311/604] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:41:59 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345 => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:42:00.063786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-fd8d9608-ef1a-40a2-954a-596a86ad513a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:00.064425 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-fd8d9608-ef1a-40a2-954a-596a86ad513a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:00.071954 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-fd8d9608-ef1a-40a2-954a-596a86ad513a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:00.072467 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-fd8d9608-ef1a-40a2-954a-596a86ad513a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:00.073343 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-fd8d9608-ef1a-40a2-954a-596a86ad513a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:00.073852 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-fd8d9608-ef1a-40a2-954a-596a86ad513a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:00.211707 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-fd8d9608-ef1a-40a2-954a-596a86ad513a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:00.219588 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-fd8d9608-ef1a-40a2-954a-596a86ad513a tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1691 microversion: 2.1 time: 0.160085 Jul 31 18:42:00.220191 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 294/605] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:42:00 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:42:00.856147 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-953ac2e4-4183-438d-82a7-3cdadbe78eea tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:00.857300 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-953ac2e4-4183-438d-82a7-3cdadbe78eea tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:00.860312 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:00.866422 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-953ac2e4-4183-438d-82a7-3cdadbe78eea tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:00.866865 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-953ac2e4-4183-438d-82a7-3cdadbe78eea tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:00.867627 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-953ac2e4-4183-438d-82a7-3cdadbe78eea tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:00.868058 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-953ac2e4-4183-438d-82a7-3cdadbe78eea tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:01.001166 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-953ac2e4-4183-438d-82a7-3cdadbe78eea tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:01.012204 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-953ac2e4-4183-438d-82a7-3cdadbe78eea tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345" status: 200 len: 1368 microversion: 2.1 time: 0.162814 Jul 31 18:42:01.012795 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 312/606] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:42:00 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:42:01.241837 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-aba03054-aab1-4b5f-aa88-0016f90e69d9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:01.242698 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-aba03054-aab1-4b5f-aa88-0016f90e69d9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:01.250580 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-aba03054-aab1-4b5f-aa88-0016f90e69d9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:01.251129 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-aba03054-aab1-4b5f-aa88-0016f90e69d9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:01.252106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-aba03054-aab1-4b5f-aa88-0016f90e69d9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:01.252610 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-aba03054-aab1-4b5f-aa88-0016f90e69d9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:01.364361 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell0:SELECT=12 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:01.391912 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-aba03054-aab1-4b5f-aa88-0016f90e69d9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:01.399415 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-aba03054-aab1-4b5f-aa88-0016f90e69d9 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1691 microversion: 2.1 time: 0.161996 Jul 31 18:42:01.399981 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 295/607] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:42:01 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:42:02.036170 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-a11776b0-a8b0-4533-b909-d2dda2402ba0 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:02.036876 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-a11776b0-a8b0-4533-b909-d2dda2402ba0 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:02.038764 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell0:SELECT=2 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:02.039460 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell0:SELECT=6 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:02.045568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a11776b0-a8b0-4533-b909-d2dda2402ba0 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:02.046228 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a11776b0-a8b0-4533-b909-d2dda2402ba0 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:02.047102 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a11776b0-a8b0-4533-b909-d2dda2402ba0 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:02.047532 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a11776b0-a8b0-4533-b909-d2dda2402ba0 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:02.185797 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-a11776b0-a8b0-4533-b909-d2dda2402ba0 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:02.197606 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-a11776b0-a8b0-4533-b909-d2dda2402ba0 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345" status: 200 len: 1368 microversion: 2.1 time: 0.166726 Jul 31 18:42:02.198236 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 313/608] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:42:02 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:42:02.425186 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-80251b67-1bf3-4792-8fef-d4bfe1f8f33e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:02.425938 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-80251b67-1bf3-4792-8fef-d4bfe1f8f33e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:02.428718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:02.435400 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-80251b67-1bf3-4792-8fef-d4bfe1f8f33e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:02.435948 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-80251b67-1bf3-4792-8fef-d4bfe1f8f33e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:02.436967 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-80251b67-1bf3-4792-8fef-d4bfe1f8f33e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:02.437449 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-80251b67-1bf3-4792-8fef-d4bfe1f8f33e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:02.599250 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-80251b67-1bf3-4792-8fef-d4bfe1f8f33e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:02.610797 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-80251b67-1bf3-4792-8fef-d4bfe1f8f33e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1691 microversion: 2.1 time: 0.191910 Jul 31 18:42:02.611550 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 296/609] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:42:02 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1691 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:42:03.229691 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-d6df1110-01e1-44e9-866c-5deaff20a197 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:03.231041 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-d6df1110-01e1-44e9-866c-5deaff20a197 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:03.240333 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d6df1110-01e1-44e9-866c-5deaff20a197 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:03.240804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d6df1110-01e1-44e9-866c-5deaff20a197 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:03.241611 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d6df1110-01e1-44e9-866c-5deaff20a197 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:03.242049 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d6df1110-01e1-44e9-866c-5deaff20a197 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:03.380795 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-d6df1110-01e1-44e9-866c-5deaff20a197 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:03.388620 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-d6df1110-01e1-44e9-866c-5deaff20a197 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345" status: 200 len: 1368 microversion: 2.1 time: 0.165576 Jul 31 18:42:03.389232 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 314/610] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:42:03 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:42:03.632995 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-d6932790-13b2-497b-aac7-c3beaead539d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:03.633689 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-d6932790-13b2-497b-aac7-c3beaead539d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:03.640309 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d6932790-13b2-497b-aac7-c3beaead539d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:03.640752 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d6932790-13b2-497b-aac7-c3beaead539d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:03.641536 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d6932790-13b2-497b-aac7-c3beaead539d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:03.641960 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d6932790-13b2-497b-aac7-c3beaead539d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:04.142831 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-d6932790-13b2-497b-aac7-c3beaead539d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:04.150626 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-d6932790-13b2-497b-aac7-c3beaead539d tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 200 len: 1691 microversion: 2.1 time: 0.521574 Jul 31 18:42:04.151281 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 297/611] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:42:03 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 1691 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:42:04.410364 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-41d436ca-9180-46b2-ae38-46e212818a5b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:04.410908 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-41d436ca-9180-46b2-ae38-46e212818a5b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:04.417558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-41d436ca-9180-46b2-ae38-46e212818a5b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:04.418034 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-41d436ca-9180-46b2-ae38-46e212818a5b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:04.418914 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-41d436ca-9180-46b2-ae38-46e212818a5b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:04.419228 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-41d436ca-9180-46b2-ae38-46e212818a5b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:04.541708 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-54902767-b094-4aaf-8579-63161432ccd0 req-c046c06d-3574-4dca-bd96-615aaf41c6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4377ead1-89c3-4e21-b45c-c20dcf7bacf9", "name": "network-vif-deleted", "tag": "4200cac4-2be0-4499-a408-eff0761571a8"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:42:04.552007 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-54902767-b094-4aaf-8579-63161432ccd0 req-c046c06d-3574-4dca-bd96-615aaf41c6c6 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:04.553191 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-54902767-b094-4aaf-8579-63161432ccd0 req-c046c06d-3574-4dca-bd96-615aaf41c6c6 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:04.558021 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-41d436ca-9180-46b2-ae38-46e212818a5b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:04.567909 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-41d436ca-9180-46b2-ae38-46e212818a5b tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345" status: 200 len: 1558 microversion: 2.1 time: 0.161626 Jul 31 18:42:04.568500 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 315/612] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:42:04 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:42:04.579192 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-54902767-b094-4aaf-8579-63161432ccd0 req-c046c06d-3574-4dca-bd96-615aaf41c6c6 service nova] Creating event network-vif-deleted:4200cac4-2be0-4499-a408-eff0761571a8 for instance 4377ead1-89c3-4e21-b45c-c20dcf7bacf9 on hv-cinder-84984 Jul 31 18:42:04.586988 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-54902767-b094-4aaf-8579-63161432ccd0 req-c046c06d-3574-4dca-bd96-615aaf41c6c6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048667 Jul 31 18:42:04.588002 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 298/613] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:42:04.590930 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-9412bff7-a7e1-4045-9a20-810db3b78fcc tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:04.591421 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-9412bff7-a7e1-4045-9a20-810db3b78fcc tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:04.598267 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9412bff7-a7e1-4045-9a20-810db3b78fcc tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:04.598710 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9412bff7-a7e1-4045-9a20-810db3b78fcc tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:04.599474 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9412bff7-a7e1-4045-9a20-810db3b78fcc tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:04.599899 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-9412bff7-a7e1-4045-9a20-810db3b78fcc tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:04.693714 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-9412bff7-a7e1-4045-9a20-810db3b78fcc tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106885 Jul 31 18:42:04.696815 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 316/614] 10.222.0.49 () {58 vars in 1275 bytes} [Sun Jul 31 18:42:04 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:42:05.172864 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-754a2222-7883-42c8-a90b-48fe9b236784 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:05.174231 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-754a2222-7883-42c8-a90b-48fe9b236784 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4377ead1-89c3-4e21-b45c-c20dcf7bacf9] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:05.180836 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-754a2222-7883-42c8-a90b-48fe9b236784 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:05.181476 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-754a2222-7883-42c8-a90b-48fe9b236784 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:05.182458 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-754a2222-7883-42c8-a90b-48fe9b236784 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:05.182886 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-754a2222-7883-42c8-a90b-48fe9b236784 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:05.201262 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-754a2222-7883-42c8-a90b-48fe9b236784 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] HTTP exception thrown: Instance 4377ead1-89c3-4e21-b45c-c20dcf7bacf9 could not be found. Jul 31 18:42:05.202963 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-754a2222-7883-42c8-a90b-48fe9b236784 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Request method failure captured: Jul 31 18:42:05.202963 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 HTTP/1.1 Jul 31 18:42:05.202963 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:42:05.202963 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:42:05.202963 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:42:05.202963 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:42:05.202963 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:42:05.202963 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:42:05.202963 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:42:05.202963 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:42:05.202963 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5svqlSgAB4kxDyQMdh6aFEcG7207X-UJC0pKHGAD88jUgWbbHA6dn_dW8BxMSIO-xgFN0o9hHxSIysSfnyB4V_TuR2QA6dHUqROz7OQx54TYPajwpKM0xUhk144NLdqXybv-XuN5zssUIo7q5QZ5Kvc-1-m2LH7B1BXkySwY7cMaByk Jul 31 18:42:05.202963 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:42:05.202963 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:42:05.202963 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:42:05.202963 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:42:05.202963 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:42:05.202963 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:42:05.202963 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: df42ccb208664e04ac753b0c64b4fab7 Jul 31 18:42:05.202963 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599579080 Jul 31 18:42:05.202963 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:42:05.202963 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:42:05.204594 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/df42ccb208664e04ac753b0c64b4fab7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_df42ccb208664e04ac753b0c64b4fab7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/df42ccb208664e04ac753b0c64b4fab7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/df42ccb208664e04ac753b0c64b4fab7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:42:05.204594 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599579080 Jul 31 18:42:05.204594 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: df42ccb208664e04ac753b0c64b4fab7 Jul 31 18:42:05.204594 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599579080 Jul 31 18:42:05.204594 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-ServerRescueNegativeTestJSON-1599579080-project Jul 31 18:42:05.204594 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:42:05.204594 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:42:05.204594 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 0d7ed577305d48c795f280e49b438bfc Jul 31 18:42:05.204594 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599579080-project Jul 31 18:42:05.204594 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: > Jul 31 18:42:05.204594 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Instance 4377ead1-89c3-4e21-b45c-c20dcf7bacf9 could not be found. Jul 31 18:42:05.204594 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': '4377ead1-89c3-4e21-b45c-c20dcf7bacf9'} Jul 31 18:42:05.205416 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:42:05.205416 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:42:05.205416 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:42:05.205416 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:42:05.205416 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:42:05.205416 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:42:05.205416 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:42:05.205416 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:42:05.205416 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:42:05.205416 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:42:05.205416 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4377ead1-89c3-4e21-b45c-c20dcf7bacf9 could not be found. Jul 31 18:42:05.205416 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:42:05.205416 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:42:05.205416 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:42:05.205416 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:42:05.205416 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:42:05.205416 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:42:05.205416 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:42:05.205416 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:42:05.205416 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:42:05.206961 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:42:05.206961 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:42:05.206961 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:42:05.206961 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:42:05.206961 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:42:05.206961 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:42:05.206961 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:42:05.206961 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4377ead1-89c3-4e21-b45c-c20dcf7bacf9 could not be found. Jul 31 18:42:05.206961 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:42:05.206961 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:42:05.206961 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:42:05.206961 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:42:05.206961 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:42:05.206961 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:42:05.206961 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:42:05.206961 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:42:05.206961 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4377ead1-89c3-4e21-b45c-c20dcf7bacf9 could not be found. Jul 31 18:42:05.206961 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:42:05.208604 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-754a2222-7883-42c8-a90b-48fe9b236784 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Returning 404 to user: Instance 4377ead1-89c3-4e21-b45c-c20dcf7bacf9 could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:42:05.208604 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-754a2222-7883-42c8-a90b-48fe9b236784 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9" status: 404 len: 111 microversion: 2.1 time: 0.036504 Jul 31 18:42:05.209009 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 299/615] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:42:05 2022] GET /compute/v2.1/servers/4377ead1-89c3-4e21-b45c-c20dcf7bacf9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:42:05.218298 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-51fbdd05-b5ef-4526-be2f-a25ea8ebfada tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '.version_select at 0x7f870980e3a0>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:05.244339 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-51fbdd05-b5ef-4526-be2f-a25ea8ebfada tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1630620146" status: 202 len: 0 microversion: 2.1 time: 0.033650 Jul 31 18:42:05.248291 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 317/616] 10.222.0.49 () {58 vars in 1221 bytes} [Sun Jul 31 18:42:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1630620146 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 18:42:05.729741 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-f20e8bec-abb2-40b4-bd8f-60842317d95b req-7caa7b3d-a6e4-4ca9-b706-647707ceae96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "393ca02e-2618-40a8-8764-5f039ebd3345", "tag": "85a54d1c-4356-47db-b52c-f53c6798c16e"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:42:05.739942 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-f20e8bec-abb2-40b4-bd8f-60842317d95b req-7caa7b3d-a6e4-4ca9-b706-647707ceae96 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:05.740384 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-f20e8bec-abb2-40b4-bd8f-60842317d95b req-7caa7b3d-a6e4-4ca9-b706-647707ceae96 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:05.753181 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-f20e8bec-abb2-40b4-bd8f-60842317d95b req-7caa7b3d-a6e4-4ca9-b706-647707ceae96 service nova] Creating event network-changed:85a54d1c-4356-47db-b52c-f53c6798c16e for instance 393ca02e-2618-40a8-8764-5f039ebd3345 on hv-cinder-84984 Jul 31 18:42:05.758515 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-f20e8bec-abb2-40b4-bd8f-60842317d95b req-7caa7b3d-a6e4-4ca9-b706-647707ceae96 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032686 Jul 31 18:42:05.763115 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 300/617] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:42:08.311632 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-ddfc252d-bba5-4d13-9795-13b5e3686e5b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:08.312120 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-ddfc252d-bba5-4d13-9795-13b5e3686e5b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:08.318510 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ddfc252d-bba5-4d13-9795-13b5e3686e5b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:08.318950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ddfc252d-bba5-4d13-9795-13b5e3686e5b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:08.319719 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ddfc252d-bba5-4d13-9795-13b5e3686e5b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:08.320142 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ddfc252d-bba5-4d13-9795-13b5e3686e5b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:08.348515 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-ddfc252d-bba5-4d13-9795-13b5e3686e5b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Going to try to terminate instance {{(pid=124334) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 18:42:08.434768 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-ddfc252d-bba5-4d13-9795-13b5e3686e5b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "DELETE /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 204 len: 0 microversion: 2.1 time: 0.127166 Jul 31 18:42:08.435453 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 318/618] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:42:08 2022] DELETE /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 18:42:08.444985 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-2b486ced-629a-42eb-b5f9-c5c34a6df9fc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:08.445693 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-2b486ced-629a-42eb-b5f9-c5c34a6df9fc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:08.452135 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2b486ced-629a-42eb-b5f9-c5c34a6df9fc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:08.452587 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2b486ced-629a-42eb-b5f9-c5c34a6df9fc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:08.453383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2b486ced-629a-42eb-b5f9-c5c34a6df9fc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:08.453820 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2b486ced-629a-42eb-b5f9-c5c34a6df9fc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:08.591018 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-2b486ced-629a-42eb-b5f9-c5c34a6df9fc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:08.598622 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-2b486ced-629a-42eb-b5f9-c5c34a6df9fc tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1508 microversion: 2.1 time: 0.158466 Jul 31 18:42:08.599198 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 301/619] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:42:08 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:42:09.498153 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-ac741832-ad14-4808-acf9-4f6edb6e9da8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:09.498942 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-ac741832-ad14-4808-acf9-4f6edb6e9da8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:09.507745 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ac741832-ad14-4808-acf9-4f6edb6e9da8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:09.508191 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ac741832-ad14-4808-acf9-4f6edb6e9da8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:09.508977 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ac741832-ad14-4808-acf9-4f6edb6e9da8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:09.509401 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ac741832-ad14-4808-acf9-4f6edb6e9da8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:09.532397 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-ac741832-ad14-4808-acf9-4f6edb6e9da8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487/ips" status: 200 len: 152 microversion: 2.20 time: 0.040087 Jul 31 18:42:09.532980 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 319/620] 10.222.0.49 () {60 vars in 1289 bytes} [Sun Jul 31 18:42:09 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 18:42:09.619624 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-af909ed0-c832-45cb-adea-5868eb4ff7b5 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:09.620225 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-af909ed0-c832-45cb-adea-5868eb4ff7b5 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:09.626463 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-af909ed0-c832-45cb-adea-5868eb4ff7b5 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:09.626918 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-af909ed0-c832-45cb-adea-5868eb4ff7b5 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:09.628008 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-af909ed0-c832-45cb-adea-5868eb4ff7b5 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:09.628463 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-af909ed0-c832-45cb-adea-5868eb4ff7b5 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:09.944296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-af909ed0-c832-45cb-adea-5868eb4ff7b5 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:09.952055 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-af909ed0-c832-45cb-adea-5868eb4ff7b5 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1508 microversion: 2.1 time: 0.336490 Jul 31 18:42:09.952617 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 302/621] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:42:09 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1508 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:42:10.973289 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-edd65626-7826-49cb-b076-f29403bdfd3f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:10.973879 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-edd65626-7826-49cb-b076-f29403bdfd3f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:10.980983 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-edd65626-7826-49cb-b076-f29403bdfd3f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:10.981420 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-edd65626-7826-49cb-b076-f29403bdfd3f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:10.982177 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-edd65626-7826-49cb-b076-f29403bdfd3f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:10.982599 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-edd65626-7826-49cb-b076-f29403bdfd3f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:11.174033 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-edd65626-7826-49cb-b076-f29403bdfd3f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:11.176352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:11.182900 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-edd65626-7826-49cb-b076-f29403bdfd3f tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 200 len: 1508 microversion: 2.1 time: 0.213532 Jul 31 18:42:11.183442 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 320/622] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:42:10 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 1508 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:42:11.317017 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-2a7eb651-5db5-42dd-aeea-67653f77e5a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:42:11.317555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-2a7eb651-5db5-42dd-aeea-67653f77e5a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:11.324875 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2a7eb651-5db5-42dd-aeea-67653f77e5a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:11.325554 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2a7eb651-5db5-42dd-aeea-67653f77e5a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:11.326501 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2a7eb651-5db5-42dd-aeea-67653f77e5a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:11.327982 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2a7eb651-5db5-42dd-aeea-67653f77e5a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:11.358900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.objects.instance [None req-2a7eb651-5db5-42dd-aeea-67653f77e5a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lazy-loading 'flavor' on Instance uuid 8c1da82e-1477-4392-a5db-0113b56cf487 {{(pid=124333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:42:11.375599 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-3e65d42c-ef84-4611-8f5a-e180d1ccaa3d req-4138493e-edcd-4b05-9f5f-2cd3b981fe08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2", "name": "network-vif-deleted", "tag": "709b893e-7977-4da7-bda4-449ee074c200"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:42:11.389794 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-3e65d42c-ef84-4611-8f5a-e180d1ccaa3d req-4138493e-edcd-4b05-9f5f-2cd3b981fe08 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:11.390540 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-3e65d42c-ef84-4611-8f5a-e180d1ccaa3d req-4138493e-edcd-4b05-9f5f-2cd3b981fe08 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:11.403690 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-3e65d42c-ef84-4611-8f5a-e180d1ccaa3d req-4138493e-edcd-4b05-9f5f-2cd3b981fe08 service nova] Creating event network-vif-deleted:709b893e-7977-4da7-bda4-449ee074c200 for instance 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 on hv-cinder-84984 Jul 31 18:42:11.409594 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-3e65d42c-ef84-4611-8f5a-e180d1ccaa3d req-4138493e-edcd-4b05-9f5f-2cd3b981fe08 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037792 Jul 31 18:42:11.410197 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 321/623] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:42:11.561964 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-2a7eb651-5db5-42dd-aeea-67653f77e5a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "POST /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487/action" status: 202 len: 0 microversion: 2.20 time: 0.248720 Jul 31 18:42:11.562562 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 303/624] 10.222.0.49 () {62 vars in 1319 bytes} [Sun Jul 31 18:42:11 2022] POST /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 18:42:11.572184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-cf16c657-47cd-4659-8940-a4f8d76e3852 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:11.572921 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-cf16c657-47cd-4659-8940-a4f8d76e3852 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:11.579800 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cf16c657-47cd-4659-8940-a4f8d76e3852 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:11.580247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cf16c657-47cd-4659-8940-a4f8d76e3852 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:11.581090 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cf16c657-47cd-4659-8940-a4f8d76e3852 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:11.581525 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cf16c657-47cd-4659-8940-a4f8d76e3852 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:11.719283 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-cf16c657-47cd-4659-8940-a4f8d76e3852 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:11.727872 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-cf16c657-47cd-4659-8940-a4f8d76e3852 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:11.729384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-cf16c657-47cd-4659-8940-a4f8d76e3852 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:11.730558 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-cf16c657-47cd-4659-8940-a4f8d76e3852 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1722 microversion: 2.20 time: 0.163401 Jul 31 18:42:11.731344 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 322/625] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:11 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:12.208681 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-038b664b-3e86-433c-8003-bf6a77079fe6 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:12.210318 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-038b664b-3e86-433c-8003-bf6a77079fe6 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:12.217615 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-038b664b-3e86-433c-8003-bf6a77079fe6 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:12.218065 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-038b664b-3e86-433c-8003-bf6a77079fe6 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:12.218816 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-038b664b-3e86-433c-8003-bf6a77079fe6 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:12.219352 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-038b664b-3e86-433c-8003-bf6a77079fe6 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:12.233737 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-038b664b-3e86-433c-8003-bf6a77079fe6 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] HTTP exception thrown: Instance 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 could not be found. Jul 31 18:42:12.235376 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-038b664b-3e86-433c-8003-bf6a77079fe6 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Request method failure captured: Jul 31 18:42:12.235376 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 HTTP/1.1 Jul 31 18:42:12.235376 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:42:12.235376 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:42:12.235376 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:42:12.235376 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:42:12.235376 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:42:12.235376 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:42:12.235376 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:42:12.235376 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:42:12.235376 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5svqlSgAB4kxDyQMdh6aFEcG7207X-UJC0pKHGAD88jUgWbbHA6dn_dW8BxMSIO-xgFN0o9hHxSIysSfnyB4V_TuR2QA6dHUqROz7OQx54TYPajwpKM0xUhk144NLdqXybv-XuN5zssUIo7q5QZ5Kvc-1-m2LH7B1BXkySwY7cMaByk Jul 31 18:42:12.235376 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:42:12.235376 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:42:12.235376 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:42:12.235376 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:42:12.235376 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:42:12.235376 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:42:12.235376 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: df42ccb208664e04ac753b0c64b4fab7 Jul 31 18:42:12.235376 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599579080 Jul 31 18:42:12.235376 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:42:12.235376 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:42:12.236686 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/df42ccb208664e04ac753b0c64b4fab7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_df42ccb208664e04ac753b0c64b4fab7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/df42ccb208664e04ac753b0c64b4fab7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/df42ccb208664e04ac753b0c64b4fab7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:42:12.236686 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599579080 Jul 31 18:42:12.236686 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: df42ccb208664e04ac753b0c64b4fab7 Jul 31 18:42:12.236686 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599579080 Jul 31 18:42:12.236686 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-ServerRescueNegativeTestJSON-1599579080-project Jul 31 18:42:12.236686 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:42:12.236686 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:42:12.236686 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 0d7ed577305d48c795f280e49b438bfc Jul 31 18:42:12.236686 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599579080-project Jul 31 18:42:12.236686 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: > Jul 31 18:42:12.236686 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Instance 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 could not be found. Jul 31 18:42:12.236686 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': '513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2'} Jul 31 18:42:12.237508 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:42:12.237508 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:42:12.237508 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:42:12.237508 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:42:12.237508 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:42:12.237508 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:42:12.237508 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:42:12.237508 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:42:12.237508 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:42:12.237508 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:42:12.237508 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 could not be found. Jul 31 18:42:12.237508 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:42:12.237508 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:42:12.237508 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:42:12.237508 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:42:12.237508 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:42:12.237508 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:42:12.237508 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:42:12.237508 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:42:12.237508 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:42:12.238643 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:42:12.238643 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:42:12.238643 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:42:12.238643 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:42:12.238643 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:42:12.238643 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:42:12.238643 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:42:12.238643 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 could not be found. Jul 31 18:42:12.238643 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:42:12.238643 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:42:12.238643 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:42:12.238643 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:42:12.238643 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:42:12.238643 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:42:12.238643 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:42:12.238643 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:42:12.238643 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 could not be found. Jul 31 18:42:12.238643 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:42:12.239724 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-038b664b-3e86-433c-8003-bf6a77079fe6 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Returning 404 to user: Instance 513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:42:12.239724 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-038b664b-3e86-433c-8003-bf6a77079fe6 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2" status: 404 len: 111 microversion: 2.1 time: 0.035281 Jul 31 18:42:12.239724 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 304/626] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:42:12 2022] GET /compute/v2.1/servers/513f62bf-4f8f-4cd7-9fbc-d61adfcae1d2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:42:12.246036 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-b93131fb-501c-4770-b514-b5c3d2c17469 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:12.246543 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-b93131fb-501c-4770-b514-b5c3d2c17469 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:12.254029 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b93131fb-501c-4770-b514-b5c3d2c17469 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:12.254479 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b93131fb-501c-4770-b514-b5c3d2c17469 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:12.255243 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b93131fb-501c-4770-b514-b5c3d2c17469 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:12.255675 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b93131fb-501c-4770-b514-b5c3d2c17469 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:12.280796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-b93131fb-501c-4770-b514-b5c3d2c17469 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Going to try to terminate instance {{(pid=124334) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 18:42:12.366786 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-b93131fb-501c-4770-b514-b5c3d2c17469 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 204 len: 0 microversion: 2.1 time: 0.124421 Jul 31 18:42:12.367438 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 323/627] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:42:12 2022] DELETE /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 18:42:12.377549 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-9b5d584c-cb61-4f2a-ad50-68024c56975b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:12.378534 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-9b5d584c-cb61-4f2a-ad50-68024c56975b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:12.386660 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9b5d584c-cb61-4f2a-ad50-68024c56975b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:12.387136 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9b5d584c-cb61-4f2a-ad50-68024c56975b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:12.387904 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9b5d584c-cb61-4f2a-ad50-68024c56975b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:12.388339 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9b5d584c-cb61-4f2a-ad50-68024c56975b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:12.520745 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-9b5d584c-cb61-4f2a-ad50-68024c56975b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:12.528475 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-9b5d584c-cb61-4f2a-ad50-68024c56975b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1521 microversion: 2.1 time: 0.156420 Jul 31 18:42:12.529034 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 305/628] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:42:12 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:42:12.759179 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-8eb18c3a-5de2-45ee-a26e-497b093757e2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:12.760188 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-8eb18c3a-5de2-45ee-a26e-497b093757e2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:12.770427 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8eb18c3a-5de2-45ee-a26e-497b093757e2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:12.771159 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8eb18c3a-5de2-45ee-a26e-497b093757e2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:12.772434 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8eb18c3a-5de2-45ee-a26e-497b093757e2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:12.773018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8eb18c3a-5de2-45ee-a26e-497b093757e2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:12.912081 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-8eb18c3a-5de2-45ee-a26e-497b093757e2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:12.920544 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-8eb18c3a-5de2-45ee-a26e-497b093757e2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:12.922073 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-8eb18c3a-5de2-45ee-a26e-497b093757e2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:12.923234 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-8eb18c3a-5de2-45ee-a26e-497b093757e2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1722 microversion: 2.20 time: 0.171781 Jul 31 18:42:12.923769 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 324/629] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:12 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:13.553461 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-a835184b-afad-4be2-b563-bbb786530182 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:13.554101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-a835184b-afad-4be2-b563-bbb786530182 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:13.564274 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a835184b-afad-4be2-b563-bbb786530182 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:13.565036 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a835184b-afad-4be2-b563-bbb786530182 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:13.566232 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a835184b-afad-4be2-b563-bbb786530182 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:13.566915 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a835184b-afad-4be2-b563-bbb786530182 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:13.713683 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-a835184b-afad-4be2-b563-bbb786530182 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:13.725380 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-a835184b-afad-4be2-b563-bbb786530182 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1521 microversion: 2.1 time: 0.178458 Jul 31 18:42:13.726311 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 306/630] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:42:13 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:42:13.948752 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-076e83d5-0a80-4385-b351-d44dd2909c69 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:13.949578 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-076e83d5-0a80-4385-b351-d44dd2909c69 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:13.958497 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-076e83d5-0a80-4385-b351-d44dd2909c69 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:13.959082 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-076e83d5-0a80-4385-b351-d44dd2909c69 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:13.960074 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-076e83d5-0a80-4385-b351-d44dd2909c69 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:13.960642 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-076e83d5-0a80-4385-b351-d44dd2909c69 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:14.097426 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-076e83d5-0a80-4385-b351-d44dd2909c69 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:14.106018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-076e83d5-0a80-4385-b351-d44dd2909c69 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:14.107498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-076e83d5-0a80-4385-b351-d44dd2909c69 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:14.108680 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-076e83d5-0a80-4385-b351-d44dd2909c69 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1722 microversion: 2.20 time: 0.165281 Jul 31 18:42:14.109238 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 325/631] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:13 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:14.751426 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-c114f3ef-7ba4-46ea-8c71-50e69002f3a3 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:14.752402 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-c114f3ef-7ba4-46ea-8c71-50e69002f3a3 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:14.761459 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c114f3ef-7ba4-46ea-8c71-50e69002f3a3 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:14.761896 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c114f3ef-7ba4-46ea-8c71-50e69002f3a3 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:14.762657 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c114f3ef-7ba4-46ea-8c71-50e69002f3a3 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:14.763084 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c114f3ef-7ba4-46ea-8c71-50e69002f3a3 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:14.895067 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-c114f3ef-7ba4-46ea-8c71-50e69002f3a3 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:14.903065 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-c114f3ef-7ba4-46ea-8c71-50e69002f3a3 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1521 microversion: 2.1 time: 0.158644 Jul 31 18:42:14.903597 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 307/632] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:42:14 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:42:15.146483 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-b5d7f94c-2ee1-42e2-b9e1-6ed9381808e1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:15.147584 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-b5d7f94c-2ee1-42e2-b9e1-6ed9381808e1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:15.154574 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b5d7f94c-2ee1-42e2-b9e1-6ed9381808e1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:15.155019 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b5d7f94c-2ee1-42e2-b9e1-6ed9381808e1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:15.155795 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b5d7f94c-2ee1-42e2-b9e1-6ed9381808e1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:15.156215 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b5d7f94c-2ee1-42e2-b9e1-6ed9381808e1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:15.300794 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-b5d7f94c-2ee1-42e2-b9e1-6ed9381808e1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:15.309563 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-b5d7f94c-2ee1-42e2-b9e1-6ed9381808e1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:15.311060 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-b5d7f94c-2ee1-42e2-b9e1-6ed9381808e1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:15.312233 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-b5d7f94c-2ee1-42e2-b9e1-6ed9381808e1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1722 microversion: 2.20 time: 0.172472 Jul 31 18:42:15.312806 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 326/633] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:15 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:15.923788 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-63ad999e-2703-4c91-ac45-b23b355f812b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:15.924395 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-63ad999e-2703-4c91-ac45-b23b355f812b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:15.931549 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-63ad999e-2703-4c91-ac45-b23b355f812b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:15.931988 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-63ad999e-2703-4c91-ac45-b23b355f812b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:15.932742 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-63ad999e-2703-4c91-ac45-b23b355f812b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:15.933204 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-63ad999e-2703-4c91-ac45-b23b355f812b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:16.071749 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-63ad999e-2703-4c91-ac45-b23b355f812b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:16.079415 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-63ad999e-2703-4c91-ac45-b23b355f812b tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1521 microversion: 2.1 time: 0.159543 Jul 31 18:42:16.079981 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 308/634] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:42:15 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:42:16.336032 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-11b26b16-e37d-4c21-9bc3-843300bf9ca9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:16.336600 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-11b26b16-e37d-4c21-9bc3-843300bf9ca9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:16.343606 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-11b26b16-e37d-4c21-9bc3-843300bf9ca9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:16.344051 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-11b26b16-e37d-4c21-9bc3-843300bf9ca9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:16.344816 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-11b26b16-e37d-4c21-9bc3-843300bf9ca9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:16.345267 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-11b26b16-e37d-4c21-9bc3-843300bf9ca9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:16.479275 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-11b26b16-e37d-4c21-9bc3-843300bf9ca9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:16.487175 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-11b26b16-e37d-4c21-9bc3-843300bf9ca9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:16.488646 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-11b26b16-e37d-4c21-9bc3-843300bf9ca9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:16.489834 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-11b26b16-e37d-4c21-9bc3-843300bf9ca9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1722 microversion: 2.20 time: 0.157975 Jul 31 18:42:16.490389 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 327/635] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:16 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:16.591912 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-cc91c1da-6804-41ef-9494-0a1807d9dfa7 req-1ecf33fe-e891-4f52-897b-cf63497c14ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c", "name": "network-vif-deleted", "tag": "7bcdc20b-6ddb-46c2-ba36-8f9cc27cf413"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:42:16.601954 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-cc91c1da-6804-41ef-9494-0a1807d9dfa7 req-1ecf33fe-e891-4f52-897b-cf63497c14ca service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:16.602417 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-cc91c1da-6804-41ef-9494-0a1807d9dfa7 req-1ecf33fe-e891-4f52-897b-cf63497c14ca service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:16.613557 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-cc91c1da-6804-41ef-9494-0a1807d9dfa7 req-1ecf33fe-e891-4f52-897b-cf63497c14ca service nova] Creating event network-vif-deleted:7bcdc20b-6ddb-46c2-ba36-8f9cc27cf413 for instance 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c on hv-cinder-84984 Jul 31 18:42:16.619286 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-cc91c1da-6804-41ef-9494-0a1807d9dfa7 req-1ecf33fe-e891-4f52-897b-cf63497c14ca service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031106 Jul 31 18:42:16.619872 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 309/636] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:42:17.102181 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-a2f0bf6b-d078-4e9b-80b2-d98dd12b600e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:17.102792 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-a2f0bf6b-d078-4e9b-80b2-d98dd12b600e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:17.109885 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a2f0bf6b-d078-4e9b-80b2-d98dd12b600e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:17.110269 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a2f0bf6b-d078-4e9b-80b2-d98dd12b600e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:17.111065 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a2f0bf6b-d078-4e9b-80b2-d98dd12b600e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:17.111485 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a2f0bf6b-d078-4e9b-80b2-d98dd12b600e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:17.147257 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a2f0bf6b-d078-4e9b-80b2-d98dd12b600e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:17.147757 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a2f0bf6b-d078-4e9b-80b2-d98dd12b600e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:17.148202 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.objects.instance [None req-a2f0bf6b-d078-4e9b-80b2-d98dd12b600e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lazy-loading 'fault' on Instance uuid 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c {{(pid=124334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:42:17.192576 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-a2f0bf6b-d078-4e9b-80b2-d98dd12b600e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7ed577305d48c795f280e49b438bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df42ccb208664e04ac753b0c64b4fab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:17.200933 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-a2f0bf6b-d078-4e9b-80b2-d98dd12b600e tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 200 len: 1312 microversion: 2.1 time: 0.102826 Jul 31 18:42:17.215253 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 328/637] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:42:17 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 1312 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:42:17.519886 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-4a2f48c1-7e77-4418-9292-322228c1e901 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:17.521054 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-4a2f48c1-7e77-4418-9292-322228c1e901 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:17.528737 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4a2f48c1-7e77-4418-9292-322228c1e901 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:17.529207 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4a2f48c1-7e77-4418-9292-322228c1e901 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:17.529956 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4a2f48c1-7e77-4418-9292-322228c1e901 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:17.530378 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4a2f48c1-7e77-4418-9292-322228c1e901 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:17.545802 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:17.666757 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-4a2f48c1-7e77-4418-9292-322228c1e901 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:17.678468 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-4a2f48c1-7e77-4418-9292-322228c1e901 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:17.679867 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-4a2f48c1-7e77-4418-9292-322228c1e901 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:17.681056 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-4a2f48c1-7e77-4418-9292-322228c1e901 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1722 microversion: 2.20 time: 0.169552 Jul 31 18:42:17.681625 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 310/638] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:17 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 18:42:18.226232 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f0569f6f-719e-44da-9eb2-abaa48cf1556 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:18.227051 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-f0569f6f-719e-44da-9eb2-abaa48cf1556 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] [instance: 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:18.238154 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f0569f6f-719e-44da-9eb2-abaa48cf1556 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:18.238887 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f0569f6f-719e-44da-9eb2-abaa48cf1556 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:18.240141 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f0569f6f-719e-44da-9eb2-abaa48cf1556 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:18.240895 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f0569f6f-719e-44da-9eb2-abaa48cf1556 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:18.254959 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-f0569f6f-719e-44da-9eb2-abaa48cf1556 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] HTTP exception thrown: Instance 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c could not be found. Jul 31 18:42:18.256624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f0569f6f-719e-44da-9eb2-abaa48cf1556 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Request method failure captured: Jul 31 18:42:18.256624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c HTTP/1.1 Jul 31 18:42:18.256624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:42:18.256624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:42:18.256624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:42:18.256624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 0 Jul 31 18:42:18.256624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:42:18.256624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:42:18.256624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:42:18.256624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:42:18.256624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5svqlSgAB4kxDyQMdh6aFEcG7207X-UJC0pKHGAD88jUgWbbHA6dn_dW8BxMSIO-xgFN0o9hHxSIysSfnyB4V_TuR2QA6dHUqROz7OQx54TYPajwpKM0xUhk144NLdqXybv-XuN5zssUIo7q5QZ5Kvc-1-m2LH7B1BXkySwY7cMaByk Jul 31 18:42:18.256624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:42:18.256624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:42:18.256624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:42:18.256624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:42:18.256624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:42:18.256624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:42:18.256624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: df42ccb208664e04ac753b0c64b4fab7 Jul 31 18:42:18.256624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599579080 Jul 31 18:42:18.256624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:42:18.256624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:42:18.258111 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/df42ccb208664e04ac753b0c64b4fab7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_df42ccb208664e04ac753b0c64b4fab7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/df42ccb208664e04ac753b0c64b4fab7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/df42ccb208664e04ac753b0c64b4fab7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:42:18.258111 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599579080 Jul 31 18:42:18.258111 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: df42ccb208664e04ac753b0c64b4fab7 Jul 31 18:42:18.258111 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599579080 Jul 31 18:42:18.258111 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-ServerRescueNegativeTestJSON-1599579080-project Jul 31 18:42:18.258111 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:42:18.258111 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:42:18.258111 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: 0d7ed577305d48c795f280e49b438bfc Jul 31 18:42:18.258111 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599579080-project Jul 31 18:42:18.258111 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: > Jul 31 18:42:18.258111 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Instance 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c could not be found. Jul 31 18:42:18.258111 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'id': '4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c'} Jul 31 18:42:18.258964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:42:18.258964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:42:18.258964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:42:18.258964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:42:18.258964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:42:18.258964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:42:18.258964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:42:18.258964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:42:18.258964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:42:18.258964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:42:18.258964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c could not be found. Jul 31 18:42:18.258964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:42:18.258964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:42:18.258964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:42:18.258964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:42:18.258964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:42:18.258964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:42:18.258964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:42:18.258964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:42:18.258964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:42:18.260096 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:42:18.260096 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:42:18.260096 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:42:18.260096 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:42:18.260096 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:42:18.260096 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:42:18.260096 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:42:18.260096 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c could not be found. Jul 31 18:42:18.260096 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:42:18.260096 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:42:18.260096 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:42:18.260096 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:42:18.260096 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:42:18.260096 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:42:18.260096 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:42:18.260096 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:42:18.260096 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c could not be found. Jul 31 18:42:18.260096 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:42:18.261187 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f0569f6f-719e-44da-9eb2-abaa48cf1556 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] Returning 404 to user: Instance 4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c could not be found. {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:42:18.261187 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-f0569f6f-719e-44da-9eb2-abaa48cf1556 tempest-ServerRescueNegativeTestJSON-1599579080 tempest-ServerRescueNegativeTestJSON-1599579080-project] 10.222.0.49 "GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c" status: 404 len: 111 microversion: 2.1 time: 0.038526 Jul 31 18:42:18.261187 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 329/639] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:42:18 2022] GET /compute/v2.1/servers/4ca7ebb0-bf5d-445b-a8d7-fe88f33c252c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:42:18.706197 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-231752f9-9f9c-4df1-accd-5e386d223e01 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:18.706776 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-231752f9-9f9c-4df1-accd-5e386d223e01 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:18.713851 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-231752f9-9f9c-4df1-accd-5e386d223e01 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:18.714354 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-231752f9-9f9c-4df1-accd-5e386d223e01 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:18.715124 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-231752f9-9f9c-4df1-accd-5e386d223e01 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:18.715617 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-231752f9-9f9c-4df1-accd-5e386d223e01 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:18.853132 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-231752f9-9f9c-4df1-accd-5e386d223e01 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:18.861654 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-231752f9-9f9c-4df1-accd-5e386d223e01 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:18.863104 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-231752f9-9f9c-4df1-accd-5e386d223e01 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:18.864275 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-231752f9-9f9c-4df1-accd-5e386d223e01 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1722 microversion: 2.20 time: 0.162121 Jul 31 18:42:18.864900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 311/640] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:18 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:19.889864 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-eed2cefc-9de6-4d6e-bc40-caf3752e7280 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:19.891035 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-eed2cefc-9de6-4d6e-bc40-caf3752e7280 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:19.897994 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-eed2cefc-9de6-4d6e-bc40-caf3752e7280 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:19.898568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-eed2cefc-9de6-4d6e-bc40-caf3752e7280 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:19.899547 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-eed2cefc-9de6-4d6e-bc40-caf3752e7280 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:19.900086 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-eed2cefc-9de6-4d6e-bc40-caf3752e7280 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:20.128955 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-eed2cefc-9de6-4d6e-bc40-caf3752e7280 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:20.140471 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-eed2cefc-9de6-4d6e-bc40-caf3752e7280 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:20.144318 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-eed2cefc-9de6-4d6e-bc40-caf3752e7280 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:20.145599 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-eed2cefc-9de6-4d6e-bc40-caf3752e7280 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1722 microversion: 2.20 time: 0.261859 Jul 31 18:42:20.146273 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 330/641] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:19 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:21.170093 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-5ef1f9d1-c5ab-4bac-b2f4-2891c0a22f95 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:21.170699 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-5ef1f9d1-c5ab-4bac-b2f4-2891c0a22f95 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:21.177312 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5ef1f9d1-c5ab-4bac-b2f4-2891c0a22f95 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:21.177759 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5ef1f9d1-c5ab-4bac-b2f4-2891c0a22f95 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:21.178522 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5ef1f9d1-c5ab-4bac-b2f4-2891c0a22f95 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:21.179003 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5ef1f9d1-c5ab-4bac-b2f4-2891c0a22f95 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:21.327803 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-5ef1f9d1-c5ab-4bac-b2f4-2891c0a22f95 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:21.339007 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-5ef1f9d1-c5ab-4bac-b2f4-2891c0a22f95 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:21.341000 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-5ef1f9d1-c5ab-4bac-b2f4-2891c0a22f95 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:21.342577 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-5ef1f9d1-c5ab-4bac-b2f4-2891c0a22f95 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1722 microversion: 2.20 time: 0.176228 Jul 31 18:42:21.343549 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 312/642] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:21 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:22.372928 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-c3e54084-1fc3-48e3-94c1-06436baee077 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:22.373588 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-c3e54084-1fc3-48e3-94c1-06436baee077 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:22.381153 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c3e54084-1fc3-48e3-94c1-06436baee077 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:22.381734 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c3e54084-1fc3-48e3-94c1-06436baee077 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:22.382697 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c3e54084-1fc3-48e3-94c1-06436baee077 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:22.383136 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c3e54084-1fc3-48e3-94c1-06436baee077 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:22.527632 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-c3e54084-1fc3-48e3-94c1-06436baee077 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:22.538171 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-c3e54084-1fc3-48e3-94c1-06436baee077 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:22.539642 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-c3e54084-1fc3-48e3-94c1-06436baee077 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:22.540833 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-c3e54084-1fc3-48e3-94c1-06436baee077 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1743 microversion: 2.20 time: 0.172221 Jul 31 18:42:22.541459 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 331/643] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:22 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:23.564588 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-e8169b13-6762-4ea2-9544-dfe2cf23327a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:23.565236 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-e8169b13-6762-4ea2-9544-dfe2cf23327a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:23.571978 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e8169b13-6762-4ea2-9544-dfe2cf23327a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:23.572416 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e8169b13-6762-4ea2-9544-dfe2cf23327a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:23.573199 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e8169b13-6762-4ea2-9544-dfe2cf23327a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:23.573625 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e8169b13-6762-4ea2-9544-dfe2cf23327a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:23.708254 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-e8169b13-6762-4ea2-9544-dfe2cf23327a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:23.716957 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-e8169b13-6762-4ea2-9544-dfe2cf23327a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:23.718580 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-e8169b13-6762-4ea2-9544-dfe2cf23327a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:23.719761 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-e8169b13-6762-4ea2-9544-dfe2cf23327a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1743 microversion: 2.20 time: 0.159063 Jul 31 18:42:23.720331 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 313/644] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:23 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:24.936085 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4bed1c84-505d-43ee-b3f1-e845fb159673 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:24.936728 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-4bed1c84-505d-43ee-b3f1-e845fb159673 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:24.943205 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4bed1c84-505d-43ee-b3f1-e845fb159673 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:24.943651 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4bed1c84-505d-43ee-b3f1-e845fb159673 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:24.944416 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4bed1c84-505d-43ee-b3f1-e845fb159673 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:24.945157 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4bed1c84-505d-43ee-b3f1-e845fb159673 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:25.087951 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-4bed1c84-505d-43ee-b3f1-e845fb159673 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:25.099702 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-4bed1c84-505d-43ee-b3f1-e845fb159673 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:25.101309 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-4bed1c84-505d-43ee-b3f1-e845fb159673 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:25.102873 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-4bed1c84-505d-43ee-b3f1-e845fb159673 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1738 microversion: 2.20 time: 0.363573 Jul 31 18:42:25.103424 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 332/645] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:24 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1738 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:26.128934 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-b04415dd-125e-4270-be72-0e27cb6a70a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:26.129541 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-b04415dd-125e-4270-be72-0e27cb6a70a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:26.136508 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b04415dd-125e-4270-be72-0e27cb6a70a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:26.136986 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b04415dd-125e-4270-be72-0e27cb6a70a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:26.137757 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b04415dd-125e-4270-be72-0e27cb6a70a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:26.138352 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b04415dd-125e-4270-be72-0e27cb6a70a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:26.330711 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-b04415dd-125e-4270-be72-0e27cb6a70a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:26.343497 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-b04415dd-125e-4270-be72-0e27cb6a70a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:26.345177 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-b04415dd-125e-4270-be72-0e27cb6a70a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:26.346637 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-b04415dd-125e-4270-be72-0e27cb6a70a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1738 microversion: 2.20 time: 0.221980 Jul 31 18:42:26.347940 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 314/646] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:26 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:26.565250 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-b3ef49fd-1327-44bb-afd8-f95a4a7b0ac5 req-4b554533-38e4-4df0-8400-fe0fcfb73617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1da82e-1477-4392-a5db-0113b56cf487", "name": "network-vif-plugged", "status": "completed", "tag": "c4842848-d109-451e-bfa5-d8934595abaf"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:42:26.576871 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-b3ef49fd-1327-44bb-afd8-f95a4a7b0ac5 req-4b554533-38e4-4df0-8400-fe0fcfb73617 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:26.577525 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-b3ef49fd-1327-44bb-afd8-f95a4a7b0ac5 req-4b554533-38e4-4df0-8400-fe0fcfb73617 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:26.592520 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-b3ef49fd-1327-44bb-afd8-f95a4a7b0ac5 req-4b554533-38e4-4df0-8400-fe0fcfb73617 service nova] Creating event network-vif-plugged:c4842848-d109-451e-bfa5-d8934595abaf for instance 8c1da82e-1477-4392-a5db-0113b56cf487 on hv-cinder-84984 Jul 31 18:42:26.601752 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-b3ef49fd-1327-44bb-afd8-f95a4a7b0ac5 req-4b554533-38e4-4df0-8400-fe0fcfb73617 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040743 Jul 31 18:42:26.603259 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 333/647] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:42:27.372393 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-3fed44c9-e0b6-474c-ad65-9d08a1eebecd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:27.374477 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-3fed44c9-e0b6-474c-ad65-9d08a1eebecd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:27.382825 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3fed44c9-e0b6-474c-ad65-9d08a1eebecd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:27.383436 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3fed44c9-e0b6-474c-ad65-9d08a1eebecd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:27.384309 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3fed44c9-e0b6-474c-ad65-9d08a1eebecd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:27.384741 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3fed44c9-e0b6-474c-ad65-9d08a1eebecd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:27.520045 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-3fed44c9-e0b6-474c-ad65-9d08a1eebecd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:27.529036 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-3fed44c9-e0b6-474c-ad65-9d08a1eebecd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:27.530721 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-3fed44c9-e0b6-474c-ad65-9d08a1eebecd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:27.532066 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-3fed44c9-e0b6-474c-ad65-9d08a1eebecd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1738 microversion: 2.20 time: 0.166045 Jul 31 18:42:27.546376 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 315/648] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:27 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:28.562055 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-768763c3-8ed5-45c8-86d7-5e1c9c458751 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:28.575458 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-768763c3-8ed5-45c8-86d7-5e1c9c458751 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:28.585392 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-768763c3-8ed5-45c8-86d7-5e1c9c458751 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:28.587701 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-768763c3-8ed5-45c8-86d7-5e1c9c458751 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:28.589017 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-768763c3-8ed5-45c8-86d7-5e1c9c458751 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:28.590212 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-768763c3-8ed5-45c8-86d7-5e1c9c458751 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:28.737916 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-768763c3-8ed5-45c8-86d7-5e1c9c458751 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:28.749170 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-768763c3-8ed5-45c8-86d7-5e1c9c458751 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:28.751380 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-768763c3-8ed5-45c8-86d7-5e1c9c458751 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:28.753152 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-768763c3-8ed5-45c8-86d7-5e1c9c458751 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1738 microversion: 2.20 time: 0.200503 Jul 31 18:42:28.765551 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 334/649] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:28 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:29.779434 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-0881aed5-4d2a-4829-9dd9-bb14dca66fda tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:29.780839 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-0881aed5-4d2a-4829-9dd9-bb14dca66fda tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:29.789263 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0881aed5-4d2a-4829-9dd9-bb14dca66fda tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:29.789988 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0881aed5-4d2a-4829-9dd9-bb14dca66fda tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:29.790921 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0881aed5-4d2a-4829-9dd9-bb14dca66fda tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:29.791498 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0881aed5-4d2a-4829-9dd9-bb14dca66fda tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:29.962226 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-0881aed5-4d2a-4829-9dd9-bb14dca66fda tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:29.970875 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-0881aed5-4d2a-4829-9dd9-bb14dca66fda tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:29.972729 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-0881aed5-4d2a-4829-9dd9-bb14dca66fda tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:29.973936 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-0881aed5-4d2a-4829-9dd9-bb14dca66fda tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1738 microversion: 2.20 time: 0.199621 Jul 31 18:42:29.974703 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 316/650] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:29 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:31.001115 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-e088d600-ecf5-4209-bf89-6dd04b9bb717 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:31.001808 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-e088d600-ecf5-4209-bf89-6dd04b9bb717 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:31.007507 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:31.009866 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e088d600-ecf5-4209-bf89-6dd04b9bb717 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:31.010366 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e088d600-ecf5-4209-bf89-6dd04b9bb717 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:31.011414 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e088d600-ecf5-4209-bf89-6dd04b9bb717 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:31.011850 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e088d600-ecf5-4209-bf89-6dd04b9bb717 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:31.190362 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-e088d600-ecf5-4209-bf89-6dd04b9bb717 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:31.199073 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-e088d600-ecf5-4209-bf89-6dd04b9bb717 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:31.201808 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-e088d600-ecf5-4209-bf89-6dd04b9bb717 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:31.204654 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-e088d600-ecf5-4209-bf89-6dd04b9bb717 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1738 microversion: 2.20 time: 0.209031 Jul 31 18:42:31.206182 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 335/651] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:30 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1738 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:32.236125 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-9255ac0b-cefc-4668-861e-4403038d1b77 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:32.238924 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-9255ac0b-cefc-4668-861e-4403038d1b77 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:32.249819 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9255ac0b-cefc-4668-861e-4403038d1b77 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:32.250403 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9255ac0b-cefc-4668-861e-4403038d1b77 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:32.251283 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9255ac0b-cefc-4668-861e-4403038d1b77 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:32.251991 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9255ac0b-cefc-4668-861e-4403038d1b77 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:32.419364 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-9255ac0b-cefc-4668-861e-4403038d1b77 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:32.428045 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-9255ac0b-cefc-4668-861e-4403038d1b77 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:32.429640 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-9255ac0b-cefc-4668-861e-4403038d1b77 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:32.430946 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-9255ac0b-cefc-4668-861e-4403038d1b77 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1738 microversion: 2.20 time: 0.203750 Jul 31 18:42:32.437997 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 317/652] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:32 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:33.460843 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-94498bd1-d175-486a-80ff-88630e1b6f6a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:33.462161 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-94498bd1-d175-486a-80ff-88630e1b6f6a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:33.470160 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-94498bd1-d175-486a-80ff-88630e1b6f6a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:33.470982 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-94498bd1-d175-486a-80ff-88630e1b6f6a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:33.471953 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-94498bd1-d175-486a-80ff-88630e1b6f6a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:33.472652 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-94498bd1-d175-486a-80ff-88630e1b6f6a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:33.616502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-94498bd1-d175-486a-80ff-88630e1b6f6a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:33.625641 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-94498bd1-d175-486a-80ff-88630e1b6f6a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:33.628492 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-94498bd1-d175-486a-80ff-88630e1b6f6a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:33.630129 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-94498bd1-d175-486a-80ff-88630e1b6f6a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1738 microversion: 2.20 time: 0.174333 Jul 31 18:42:33.646232 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 336/653] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:33 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:34.655873 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-b529c892-5007-4122-bf2d-e9131bf37c48 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:34.656509 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-b529c892-5007-4122-bf2d-e9131bf37c48 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:34.659018 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=44 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:34.664461 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b529c892-5007-4122-bf2d-e9131bf37c48 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:34.664949 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b529c892-5007-4122-bf2d-e9131bf37c48 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:34.665776 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b529c892-5007-4122-bf2d-e9131bf37c48 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:34.666207 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b529c892-5007-4122-bf2d-e9131bf37c48 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:34.819748 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-b529c892-5007-4122-bf2d-e9131bf37c48 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:34.828414 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-b529c892-5007-4122-bf2d-e9131bf37c48 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:34.829945 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-b529c892-5007-4122-bf2d-e9131bf37c48 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:34.831095 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-b529c892-5007-4122-bf2d-e9131bf37c48 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1738 microversion: 2.20 time: 0.179372 Jul 31 18:42:34.831658 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 318/654] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:34 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:35.854573 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-6ceb5a3e-76a9-4ebd-b634-6e07eb40fb7c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:35.855244 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-6ceb5a3e-76a9-4ebd-b634-6e07eb40fb7c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:35.862062 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6ceb5a3e-76a9-4ebd-b634-6e07eb40fb7c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:35.862505 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6ceb5a3e-76a9-4ebd-b634-6e07eb40fb7c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:35.863276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6ceb5a3e-76a9-4ebd-b634-6e07eb40fb7c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:35.863704 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6ceb5a3e-76a9-4ebd-b634-6e07eb40fb7c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:35.975201 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-24e17310-a392-499b-bc7b-d8aaa641d81c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:35.975727 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-24e17310-a392-499b-bc7b-d8aaa641d81c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:35.981885 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-24e17310-a392-499b-bc7b-d8aaa641d81c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:35.982403 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-24e17310-a392-499b-bc7b-d8aaa641d81c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:35.983160 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-24e17310-a392-499b-bc7b-d8aaa641d81c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:35.983591 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-24e17310-a392-499b-bc7b-d8aaa641d81c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:35.997662 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:36.010115 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-24e17310-a392-499b-bc7b-d8aaa641d81c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725/ips" status: 200 len: 145 microversion: 2.1 time: 0.218770 Jul 31 18:42:36.010674 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 337/655] 10.222.0.49 () {58 vars in 1248 bytes} [Sun Jul 31 18:42:35 2022] GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725/ips => generated 145 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:42:36.118145 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-6ceb5a3e-76a9-4ebd-b634-6e07eb40fb7c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:36.126411 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-6ceb5a3e-76a9-4ebd-b634-6e07eb40fb7c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:36.128260 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-6ceb5a3e-76a9-4ebd-b634-6e07eb40fb7c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:36.129439 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-6ceb5a3e-76a9-4ebd-b634-6e07eb40fb7c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1720 microversion: 2.20 time: 0.279024 Jul 31 18:42:36.130181 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 319/656] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:35 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1720 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:37.154781 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-aa93f707-6dd0-4e5c-97a8-f4fd404787c4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:37.155392 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-aa93f707-6dd0-4e5c-97a8-f4fd404787c4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:37.163292 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-aa93f707-6dd0-4e5c-97a8-f4fd404787c4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:37.163720 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-aa93f707-6dd0-4e5c-97a8-f4fd404787c4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:37.164535 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-aa93f707-6dd0-4e5c-97a8-f4fd404787c4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:37.164991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-aa93f707-6dd0-4e5c-97a8-f4fd404787c4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:37.301922 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-aa93f707-6dd0-4e5c-97a8-f4fd404787c4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:37.310152 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-aa93f707-6dd0-4e5c-97a8-f4fd404787c4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:37.311637 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-aa93f707-6dd0-4e5c-97a8-f4fd404787c4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:37.312822 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-aa93f707-6dd0-4e5c-97a8-f4fd404787c4 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1720 microversion: 2.20 time: 0.162309 Jul 31 18:42:37.324830 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 338/657] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:37 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:37.356232 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-fd2f69c5-15ee-4894-b640-142b83da5c98 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1245d73e-e4ea-470d-b58b-2686663abfab"}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:42:37.359342 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-fd2f69c5-15ee-4894-b640-142b83da5c98 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:37.366352 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-fd2f69c5-15ee-4894-b640-142b83da5c98 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:37.366824 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-fd2f69c5-15ee-4894-b640-142b83da5c98 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:37.367689 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-fd2f69c5-15ee-4894-b640-142b83da5c98 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:37.368125 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-fd2f69c5-15ee-4894-b640-142b83da5c98 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:37.871346 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-fd2f69c5-15ee-4894-b640-142b83da5c98 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "POST /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.519123 Jul 31 18:42:37.872266 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 320/658] 10.222.0.49 () {60 vars in 1323 bytes} [Sun Jul 31 18:42:37 2022] POST /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725/os-volume_attachments => generated 194 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:42:38.336531 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-02290bb6-41a6-4632-8625-126f56a0a9cd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:38.337174 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-02290bb6-41a6-4632-8625-126f56a0a9cd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:38.343779 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-02290bb6-41a6-4632-8625-126f56a0a9cd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:38.344232 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-02290bb6-41a6-4632-8625-126f56a0a9cd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:38.345025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-02290bb6-41a6-4632-8625-126f56a0a9cd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:38.345458 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-02290bb6-41a6-4632-8625-126f56a0a9cd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:38.481362 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-02290bb6-41a6-4632-8625-126f56a0a9cd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:38.489838 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-02290bb6-41a6-4632-8625-126f56a0a9cd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:38.491351 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-02290bb6-41a6-4632-8625-126f56a0a9cd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:38.492636 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-02290bb6-41a6-4632-8625-126f56a0a9cd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1663 microversion: 2.20 time: 0.160371 Jul 31 18:42:38.493212 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 339/659] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:38 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:38.518160 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-93b56c02-a645-4b40-9c3e-04b99e0a8fbf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fab1198f-a21a-4a5c-a8a6-461c90f3f7b5"}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:42:38.521341 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-93b56c02-a645-4b40-9c3e-04b99e0a8fbf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:38.530935 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-93b56c02-a645-4b40-9c3e-04b99e0a8fbf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:38.531391 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-93b56c02-a645-4b40-9c3e-04b99e0a8fbf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:38.532170 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-93b56c02-a645-4b40-9c3e-04b99e0a8fbf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:38.532607 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-93b56c02-a645-4b40-9c3e-04b99e0a8fbf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:38.844263 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-93b56c02-a645-4b40-9c3e-04b99e0a8fbf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "POST /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.331364 Jul 31 18:42:38.844900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 321/660] 10.222.0.49 () {62 vars in 1364 bytes} [Sun Jul 31 18:42:38 2022] POST /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487/os-volume_attachments => generated 188 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 18:42:38.967869 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-8804979c-ce4b-48ee-8dee-a8d094a136d7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:38.968563 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-8804979c-ce4b-48ee-8dee-a8d094a136d7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:38.976242 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8804979c-ce4b-48ee-8dee-a8d094a136d7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:38.976995 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8804979c-ce4b-48ee-8dee-a8d094a136d7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:38.977976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8804979c-ce4b-48ee-8dee-a8d094a136d7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:38.978832 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8804979c-ce4b-48ee-8dee-a8d094a136d7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:39.230375 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-8804979c-ce4b-48ee-8dee-a8d094a136d7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487/os-volume_attachments/fab1198f-a21a-4a5c-a8a6-461c90f3f7b5" status: 202 len: 0 microversion: 2.20 time: 0.266457 Jul 31 18:42:39.231260 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 340/661] 10.222.0.49 () {60 vars in 1457 bytes} [Sun Jul 31 18:42:38 2022] DELETE /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487/os-volume_attachments/fab1198f-a21a-4a5c-a8a6-461c90f3f7b5 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 18:42:39.294491 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-3f725f06-3aed-4160-b194-3f0c3880a787 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:42:39.295194 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-3f725f06-3aed-4160-b194-3f0c3880a787 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:39.303898 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3f725f06-3aed-4160-b194-3f0c3880a787 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:39.304506 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3f725f06-3aed-4160-b194-3f0c3880a787 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:39.305609 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3f725f06-3aed-4160-b194-3f0c3880a787 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:39.306307 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3f725f06-3aed-4160-b194-3f0c3880a787 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:39.342935 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-3f725f06-3aed-4160-b194-3f0c3880a787 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124333) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 31 18:42:39.381890 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:39.418122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-3f725f06-3aed-4160-b194-3f0c3880a787 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "POST /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487/action" status: 202 len: 0 microversion: 2.20 time: 0.128393 Jul 31 18:42:39.421827 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 322/662] 10.222.0.49 () {62 vars in 1319 bytes} [Sun Jul 31 18:42:39 2022] POST /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 18:42:39.427691 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-6adffb0d-8712-4e19-8163-8589ad1d12c8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:39.428241 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-6adffb0d-8712-4e19-8163-8589ad1d12c8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:39.434534 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6adffb0d-8712-4e19-8163-8589ad1d12c8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:39.434979 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6adffb0d-8712-4e19-8163-8589ad1d12c8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:39.435751 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6adffb0d-8712-4e19-8163-8589ad1d12c8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:39.436190 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6adffb0d-8712-4e19-8163-8589ad1d12c8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:39.578241 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-6adffb0d-8712-4e19-8163-8589ad1d12c8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:39.585992 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-6adffb0d-8712-4e19-8163-8589ad1d12c8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:39.587487 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-6adffb0d-8712-4e19-8163-8589ad1d12c8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:39.589006 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-6adffb0d-8712-4e19-8163-8589ad1d12c8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1671 microversion: 2.20 time: 0.165805 Jul 31 18:42:39.590607 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 341/663] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:39 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 18:42:40.547150 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-53a5f82c-45c1-490d-9c1d-a8505ffbf1f3 req-4488102f-5f6e-4c41-8e0c-ebb4a5d3442b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1da82e-1477-4392-a5db-0113b56cf487", "name": "network-vif-unplugged", "status": "completed", "tag": "c4842848-d109-451e-bfa5-d8934595abaf"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:42:40.558093 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-53a5f82c-45c1-490d-9c1d-a8505ffbf1f3 req-4488102f-5f6e-4c41-8e0c-ebb4a5d3442b service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:40.558792 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-53a5f82c-45c1-490d-9c1d-a8505ffbf1f3 req-4488102f-5f6e-4c41-8e0c-ebb4a5d3442b service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:40.577396 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.compute.server_external_events [req-53a5f82c-45c1-490d-9c1d-a8505ffbf1f3 req-4488102f-5f6e-4c41-8e0c-ebb4a5d3442b service nova] Unable to find a host for instance 8c1da82e-1477-4392-a5db-0113b56cf487. Dropping event network-vif-unplugged {{(pid=124333) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 31 18:42:40.578763 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-53a5f82c-45c1-490d-9c1d-a8505ffbf1f3 req-4488102f-5f6e-4c41-8e0c-ebb4a5d3442b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036050 Jul 31 18:42:40.579464 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 323/664] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 31 18:42:40.613350 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-a97e64a9-f50d-4767-9c7a-d7d4d30f35c9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:40.613964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-a97e64a9-f50d-4767-9c7a-d7d4d30f35c9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:40.620651 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a97e64a9-f50d-4767-9c7a-d7d4d30f35c9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:40.621120 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a97e64a9-f50d-4767-9c7a-d7d4d30f35c9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:40.621885 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a97e64a9-f50d-4767-9c7a-d7d4d30f35c9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:40.622288 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a97e64a9-f50d-4767-9c7a-d7d4d30f35c9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:40.770079 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-a97e64a9-f50d-4767-9c7a-d7d4d30f35c9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:40.778649 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-a97e64a9-f50d-4767-9c7a-d7d4d30f35c9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:40.780177 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-a97e64a9-f50d-4767-9c7a-d7d4d30f35c9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:40.781738 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-a97e64a9-f50d-4767-9c7a-d7d4d30f35c9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1673 microversion: 2.20 time: 0.172575 Jul 31 18:42:40.782436 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 342/665] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:40 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 18:42:41.805389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-7d67b3d0-697a-4a4b-9564-3260a2a97db3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:41.805998 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-7d67b3d0-697a-4a4b-9564-3260a2a97db3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:41.813010 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7d67b3d0-697a-4a4b-9564-3260a2a97db3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:41.813455 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7d67b3d0-697a-4a4b-9564-3260a2a97db3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:41.814222 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7d67b3d0-697a-4a4b-9564-3260a2a97db3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:41.814652 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7d67b3d0-697a-4a4b-9564-3260a2a97db3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:41.953313 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-7d67b3d0-697a-4a4b-9564-3260a2a97db3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:41.961860 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-7d67b3d0-697a-4a4b-9564-3260a2a97db3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:41.963362 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-7d67b3d0-697a-4a4b-9564-3260a2a97db3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:41.964508 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-7d67b3d0-697a-4a4b-9564-3260a2a97db3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1729 microversion: 2.20 time: 0.163096 Jul 31 18:42:41.965073 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 324/666] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:41 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:42.991838 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-11f70563-134b-46cc-82ff-754935d84232 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:42.992537 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-11f70563-134b-46cc-82ff-754935d84232 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:42.999419 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-11f70563-134b-46cc-82ff-754935d84232 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:42.999979 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-11f70563-134b-46cc-82ff-754935d84232 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:43.000795 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-11f70563-134b-46cc-82ff-754935d84232 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:43.001299 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-11f70563-134b-46cc-82ff-754935d84232 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:43.148852 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-11f70563-134b-46cc-82ff-754935d84232 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:43.159171 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-11f70563-134b-46cc-82ff-754935d84232 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:43.161223 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-11f70563-134b-46cc-82ff-754935d84232 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:43.162499 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-11f70563-134b-46cc-82ff-754935d84232 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1729 microversion: 2.20 time: 0.176983 Jul 31 18:42:43.163064 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 343/667] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:42 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:44.186955 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-c86b5d03-228c-4cc2-8410-842f764211a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:44.187516 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-c86b5d03-228c-4cc2-8410-842f764211a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:44.194376 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c86b5d03-228c-4cc2-8410-842f764211a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:44.194827 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c86b5d03-228c-4cc2-8410-842f764211a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:44.195702 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c86b5d03-228c-4cc2-8410-842f764211a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:44.196141 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c86b5d03-228c-4cc2-8410-842f764211a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:44.358298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-c86b5d03-228c-4cc2-8410-842f764211a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:44.366606 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-c86b5d03-228c-4cc2-8410-842f764211a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:44.368326 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-c86b5d03-228c-4cc2-8410-842f764211a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:44.369543 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-c86b5d03-228c-4cc2-8410-842f764211a7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1729 microversion: 2.20 time: 0.187288 Jul 31 18:42:44.370097 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 325/668] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:44 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:45.402429 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-536b07e6-b5b5-41d7-8f65-051df0b0ed04 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:45.403034 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-536b07e6-b5b5-41d7-8f65-051df0b0ed04 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:45.410405 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-536b07e6-b5b5-41d7-8f65-051df0b0ed04 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:45.410946 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-536b07e6-b5b5-41d7-8f65-051df0b0ed04 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:45.411794 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-536b07e6-b5b5-41d7-8f65-051df0b0ed04 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:45.412274 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-536b07e6-b5b5-41d7-8f65-051df0b0ed04 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:45.780345 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-536b07e6-b5b5-41d7-8f65-051df0b0ed04 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:45.788910 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-536b07e6-b5b5-41d7-8f65-051df0b0ed04 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:45.790456 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-536b07e6-b5b5-41d7-8f65-051df0b0ed04 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:45.791651 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-536b07e6-b5b5-41d7-8f65-051df0b0ed04 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1729 microversion: 2.20 time: 0.393167 Jul 31 18:42:45.792224 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 344/669] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:45 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1729 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:46.816191 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-7b963967-6a55-4609-9575-a98730a6a0ac tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:46.816778 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-7b963967-6a55-4609-9575-a98730a6a0ac tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:46.829148 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7b963967-6a55-4609-9575-a98730a6a0ac tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:46.829738 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7b963967-6a55-4609-9575-a98730a6a0ac tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:46.830626 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7b963967-6a55-4609-9575-a98730a6a0ac tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:46.831055 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7b963967-6a55-4609-9575-a98730a6a0ac tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:46.981341 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-7b963967-6a55-4609-9575-a98730a6a0ac tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:46.990875 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-7b963967-6a55-4609-9575-a98730a6a0ac tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:46.992728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-7b963967-6a55-4609-9575-a98730a6a0ac tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:46.993933 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-7b963967-6a55-4609-9575-a98730a6a0ac tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1729 microversion: 2.20 time: 0.181838 Jul 31 18:42:46.994491 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 326/670] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:46 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:48.017488 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-90b3378e-07ae-4588-aa94-9abd0ccee2c1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:48.018896 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-90b3378e-07ae-4588-aa94-9abd0ccee2c1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:48.026752 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-90b3378e-07ae-4588-aa94-9abd0ccee2c1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:48.027330 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-90b3378e-07ae-4588-aa94-9abd0ccee2c1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:48.028145 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-90b3378e-07ae-4588-aa94-9abd0ccee2c1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:48.028582 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-90b3378e-07ae-4588-aa94-9abd0ccee2c1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:48.174623 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-90b3378e-07ae-4588-aa94-9abd0ccee2c1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:48.183853 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-90b3378e-07ae-4588-aa94-9abd0ccee2c1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:48.185373 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-90b3378e-07ae-4588-aa94-9abd0ccee2c1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:48.186548 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-90b3378e-07ae-4588-aa94-9abd0ccee2c1 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1729 microversion: 2.20 time: 0.173225 Jul 31 18:42:48.187188 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 345/671] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:48 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:49.210420 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-3a56c67a-8ae4-404a-876e-73c6a6b1bdbf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:49.211806 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-3a56c67a-8ae4-404a-876e-73c6a6b1bdbf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:49.221668 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3a56c67a-8ae4-404a-876e-73c6a6b1bdbf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:49.222019 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3a56c67a-8ae4-404a-876e-73c6a6b1bdbf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:49.224286 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3a56c67a-8ae4-404a-876e-73c6a6b1bdbf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:49.224831 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3a56c67a-8ae4-404a-876e-73c6a6b1bdbf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:49.342507 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-8912f3bc-8b53-401b-b394-15e197757400 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:49.343166 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-8912f3bc-8b53-401b-b394-15e197757400 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:49.349844 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8912f3bc-8b53-401b-b394-15e197757400 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:49.350289 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8912f3bc-8b53-401b-b394-15e197757400 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:49.351107 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8912f3bc-8b53-401b-b394-15e197757400 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:49.351605 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8912f3bc-8b53-401b-b394-15e197757400 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:49.375564 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-8912f3bc-8b53-401b-b394-15e197757400 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345/ips" status: 200 len: 148 microversion: 2.1 time: 0.186381 Jul 31 18:42:49.376121 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 327/672] 10.222.0.49 () {58 vars in 1248 bytes} [Sun Jul 31 18:42:49 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345/ips => generated 148 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:42:49.380818 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-3a56c67a-8ae4-404a-876e-73c6a6b1bdbf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:49.390182 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-3a56c67a-8ae4-404a-876e-73c6a6b1bdbf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:49.391832 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-3a56c67a-8ae4-404a-876e-73c6a6b1bdbf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:49.393033 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-3a56c67a-8ae4-404a-876e-73c6a6b1bdbf tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1729 microversion: 2.20 time: 0.186412 Jul 31 18:42:49.393753 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 346/673] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:49 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:50.418815 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-dc3cf37b-3d20-41e9-8806-5b857f32c20a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:50.420312 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-dc3cf37b-3d20-41e9-8806-5b857f32c20a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:50.427962 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-dc3cf37b-3d20-41e9-8806-5b857f32c20a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:50.428416 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-dc3cf37b-3d20-41e9-8806-5b857f32c20a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:50.429226 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-dc3cf37b-3d20-41e9-8806-5b857f32c20a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:50.429784 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-dc3cf37b-3d20-41e9-8806-5b857f32c20a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:50.580486 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-dc3cf37b-3d20-41e9-8806-5b857f32c20a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:50.588778 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-dc3cf37b-3d20-41e9-8806-5b857f32c20a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:50.590273 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-dc3cf37b-3d20-41e9-8806-5b857f32c20a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:50.591431 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-dc3cf37b-3d20-41e9-8806-5b857f32c20a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1729 microversion: 2.20 time: 0.179090 Jul 31 18:42:50.591985 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 328/674] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:50 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:50.790115 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-c2d994de-ac04-4462-918a-a281b0d1cd66 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65f92705-f08d-4aae-a75b-be9b8054e59a"}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:42:50.792569 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-c2d994de-ac04-4462-918a-a281b0d1cd66 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:50.799363 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c2d994de-ac04-4462-918a-a281b0d1cd66 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:50.799808 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c2d994de-ac04-4462-918a-a281b0d1cd66 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:50.800573 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c2d994de-ac04-4462-918a-a281b0d1cd66 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:50.801036 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c2d994de-ac04-4462-918a-a281b0d1cd66 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:51.615065 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-4a8ad39b-89e9-46de-ae66-d5d3498aee30 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:51.615681 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-4a8ad39b-89e9-46de-ae66-d5d3498aee30 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:51.622746 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4a8ad39b-89e9-46de-ae66-d5d3498aee30 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:51.623192 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4a8ad39b-89e9-46de-ae66-d5d3498aee30 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:51.623955 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4a8ad39b-89e9-46de-ae66-d5d3498aee30 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:51.624387 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4a8ad39b-89e9-46de-ae66-d5d3498aee30 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:51.766348 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-4a8ad39b-89e9-46de-ae66-d5d3498aee30 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:51.774467 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-4a8ad39b-89e9-46de-ae66-d5d3498aee30 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:51.775956 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-4a8ad39b-89e9-46de-ae66-d5d3498aee30 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:51.777113 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-4a8ad39b-89e9-46de-ae66-d5d3498aee30 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1729 microversion: 2.20 time: 0.166111 Jul 31 18:42:51.777674 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 329/675] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:51 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:52.800819 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-f78a2413-675c-49b6-887f-3cde413814c7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:52.801439 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-f78a2413-675c-49b6-887f-3cde413814c7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:52.808549 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f78a2413-675c-49b6-887f-3cde413814c7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:52.809157 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f78a2413-675c-49b6-887f-3cde413814c7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:52.809951 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f78a2413-675c-49b6-887f-3cde413814c7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:52.810396 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f78a2413-675c-49b6-887f-3cde413814c7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:52.962884 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-f78a2413-675c-49b6-887f-3cde413814c7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:52.970990 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-f78a2413-675c-49b6-887f-3cde413814c7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:52.972605 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-f78a2413-675c-49b6-887f-3cde413814c7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:52.973833 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-f78a2413-675c-49b6-887f-3cde413814c7 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1729 microversion: 2.20 time: 0.177060 Jul 31 18:42:52.974501 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 330/676] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:52 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:53.003808 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-c2d994de-ac04-4462-918a-a281b0d1cd66 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "POST /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.217670 Jul 31 18:42:53.004414 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 347/677] 10.222.0.49 () {60 vars in 1323 bytes} [Sun Jul 31 18:42:50 2022] POST /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345/os-volume_attachments => generated 194 bytes in 2219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:42:53.998157 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-cd3b2dfb-b21b-4267-8ae7-9e4ea3036bea tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:53.998891 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-cd3b2dfb-b21b-4267-8ae7-9e4ea3036bea tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:54.005871 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cd3b2dfb-b21b-4267-8ae7-9e4ea3036bea tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:54.006320 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cd3b2dfb-b21b-4267-8ae7-9e4ea3036bea tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:54.007088 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cd3b2dfb-b21b-4267-8ae7-9e4ea3036bea tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:54.007992 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cd3b2dfb-b21b-4267-8ae7-9e4ea3036bea tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:54.028046 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-5817da4b-4ac3-40e0-9505-2f18b9997376 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:54.030413 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-5817da4b-4ac3-40e0-9505-2f18b9997376 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:54.036615 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5817da4b-4ac3-40e0-9505-2f18b9997376 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:54.037271 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5817da4b-4ac3-40e0-9505-2f18b9997376 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:54.038781 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5817da4b-4ac3-40e0-9505-2f18b9997376 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:54.039819 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5817da4b-4ac3-40e0-9505-2f18b9997376 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:54.072806 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-5817da4b-4ac3-40e0-9505-2f18b9997376 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049569 Jul 31 18:42:54.079024 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 348/678] 10.222.0.49 () {58 vars in 1302 bytes} [Sun Jul 31 18:42:54 2022] GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:42:54.084454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-27842457-1ed5-4f4e-bc64-b7eb0d68b93c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:54.084454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-27842457-1ed5-4f4e-bc64-b7eb0d68b93c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:54.090487 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-27842457-1ed5-4f4e-bc64-b7eb0d68b93c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:54.090944 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-27842457-1ed5-4f4e-bc64-b7eb0d68b93c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:54.091696 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-27842457-1ed5-4f4e-bc64-b7eb0d68b93c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:54.092127 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-27842457-1ed5-4f4e-bc64-b7eb0d68b93c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:54.122118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-27842457-1ed5-4f4e-bc64-b7eb0d68b93c tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725/os-volume_attachments/1245d73e-e4ea-470d-b58b-2686663abfab" status: 200 len: 194 microversion: 2.1 time: 0.041967 Jul 31 18:42:54.122874 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 349/679] 10.222.0.49 () {58 vars in 1413 bytes} [Sun Jul 31 18:42:54 2022] GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725/os-volume_attachments/1245d73e-e4ea-470d-b58b-2686663abfab => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:42:54.145234 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-cd3b2dfb-b21b-4267-8ae7-9e4ea3036bea tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:54.153176 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-cd3b2dfb-b21b-4267-8ae7-9e4ea3036bea tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:54.154770 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-cd3b2dfb-b21b-4267-8ae7-9e4ea3036bea tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:54.155984 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-cd3b2dfb-b21b-4267-8ae7-9e4ea3036bea tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1729 microversion: 2.20 time: 0.162621 Jul 31 18:42:54.156578 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 331/680] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:53 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:55.179548 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-21b9e44c-9217-4407-9a96-20c6a4158ebe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:55.180156 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-21b9e44c-9217-4407-9a96-20c6a4158ebe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:55.186825 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-21b9e44c-9217-4407-9a96-20c6a4158ebe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:55.187272 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-21b9e44c-9217-4407-9a96-20c6a4158ebe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:55.188038 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-21b9e44c-9217-4407-9a96-20c6a4158ebe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:55.188470 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-21b9e44c-9217-4407-9a96-20c6a4158ebe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:55.206788 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:42:55.321735 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-21b9e44c-9217-4407-9a96-20c6a4158ebe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:55.329865 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-21b9e44c-9217-4407-9a96-20c6a4158ebe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:55.331395 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-21b9e44c-9217-4407-9a96-20c6a4158ebe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:55.332557 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-21b9e44c-9217-4407-9a96-20c6a4158ebe tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1729 microversion: 2.20 time: 0.157708 Jul 31 18:42:55.333144 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 350/681] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:55 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 18:42:55.464165 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-37f625da-ef8c-4b3c-a1fe-5c0df1af3107 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eec407fc-337a-49ed-9b67-11c38fff034d"}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:42:55.466926 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-37f625da-ef8c-4b3c-a1fe-5c0df1af3107 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:55.473901 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-37f625da-ef8c-4b3c-a1fe-5c0df1af3107 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:55.474437 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-37f625da-ef8c-4b3c-a1fe-5c0df1af3107 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:55.475292 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-37f625da-ef8c-4b3c-a1fe-5c0df1af3107 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:55.475793 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-37f625da-ef8c-4b3c-a1fe-5c0df1af3107 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:55.843570 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-37f625da-ef8c-4b3c-a1fe-5c0df1af3107 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "POST /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.383682 Jul 31 18:42:55.844194 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 332/682] 10.222.0.49 () {60 vars in 1323 bytes} [Sun Jul 31 18:42:55 2022] POST /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725/os-volume_attachments => generated 194 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:42:56.360393 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-da3e2368-7b42-471c-bde6-b1b8a3f280ab tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:56.361431 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-da3e2368-7b42-471c-bde6-b1b8a3f280ab tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:56.370954 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-da3e2368-7b42-471c-bde6-b1b8a3f280ab tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:56.371378 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-da3e2368-7b42-471c-bde6-b1b8a3f280ab tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:56.372189 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-da3e2368-7b42-471c-bde6-b1b8a3f280ab tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:56.372602 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-da3e2368-7b42-471c-bde6-b1b8a3f280ab tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:56.512064 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-da3e2368-7b42-471c-bde6-b1b8a3f280ab tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:56.521895 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-da3e2368-7b42-471c-bde6-b1b8a3f280ab tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:56.523369 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-da3e2368-7b42-471c-bde6-b1b8a3f280ab tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:56.524799 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-da3e2368-7b42-471c-bde6-b1b8a3f280ab tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1729 microversion: 2.20 time: 0.170940 Jul 31 18:42:56.525653 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 351/683] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:56 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:57.552974 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-61cbe772-2adf-47c8-8bf6-043ea2a7dee8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:57.554036 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-61cbe772-2adf-47c8-8bf6-043ea2a7dee8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:57.565507 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-61cbe772-2adf-47c8-8bf6-043ea2a7dee8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:57.566230 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-61cbe772-2adf-47c8-8bf6-043ea2a7dee8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:57.567468 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-61cbe772-2adf-47c8-8bf6-043ea2a7dee8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:57.568180 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-61cbe772-2adf-47c8-8bf6-043ea2a7dee8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:57.706475 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-61cbe772-2adf-47c8-8bf6-043ea2a7dee8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:57.714876 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-61cbe772-2adf-47c8-8bf6-043ea2a7dee8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:57.716366 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-61cbe772-2adf-47c8-8bf6-043ea2a7dee8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:57.717555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-61cbe772-2adf-47c8-8bf6-043ea2a7dee8 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1729 microversion: 2.20 time: 0.171929 Jul 31 18:42:57.718145 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 333/684] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:57 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:58.744885 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-666a555e-5b8c-4042-8dc6-50c09a0acaf9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:58.745524 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-666a555e-5b8c-4042-8dc6-50c09a0acaf9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:58.752206 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-666a555e-5b8c-4042-8dc6-50c09a0acaf9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:58.753030 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-666a555e-5b8c-4042-8dc6-50c09a0acaf9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:58.753808 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-666a555e-5b8c-4042-8dc6-50c09a0acaf9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:58.754384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-666a555e-5b8c-4042-8dc6-50c09a0acaf9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:58.885876 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-666a555e-5b8c-4042-8dc6-50c09a0acaf9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:58.897643 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-666a555e-5b8c-4042-8dc6-50c09a0acaf9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:58.899853 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-666a555e-5b8c-4042-8dc6-50c09a0acaf9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:42:58.901282 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-666a555e-5b8c-4042-8dc6-50c09a0acaf9 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1729 microversion: 2.20 time: 0.162093 Jul 31 18:42:58.902017 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 352/685] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:58 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:42:59.929168 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-50ec4510-8586-4a8d-a17b-b90bac09d196 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:42:59.930000 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-50ec4510-8586-4a8d-a17b-b90bac09d196 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:42:59.936622 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-50ec4510-8586-4a8d-a17b-b90bac09d196 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:59.937086 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-50ec4510-8586-4a8d-a17b-b90bac09d196 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:42:59.937824 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-50ec4510-8586-4a8d-a17b-b90bac09d196 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:42:59.940327 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-50ec4510-8586-4a8d-a17b-b90bac09d196 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:00.071370 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-50ec4510-8586-4a8d-a17b-b90bac09d196 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:00.079925 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-50ec4510-8586-4a8d-a17b-b90bac09d196 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:00.081513 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-50ec4510-8586-4a8d-a17b-b90bac09d196 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:00.082986 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-50ec4510-8586-4a8d-a17b-b90bac09d196 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1729 microversion: 2.20 time: 0.157786 Jul 31 18:43:00.099291 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 334/686] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:42:59 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:43:00.166266 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-812c5ad5-ed00-486d-bb38-140dcec6b11b req-fc932bf8-6d75-4b6f-ac1c-a730c947591c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1da82e-1477-4392-a5db-0113b56cf487", "name": "network-vif-plugged", "status": "completed", "tag": "c4842848-d109-451e-bfa5-d8934595abaf"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:43:00.175652 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-812c5ad5-ed00-486d-bb38-140dcec6b11b req-fc932bf8-6d75-4b6f-ac1c-a730c947591c service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:00.176085 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-812c5ad5-ed00-486d-bb38-140dcec6b11b req-fc932bf8-6d75-4b6f-ac1c-a730c947591c service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:00.186749 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-812c5ad5-ed00-486d-bb38-140dcec6b11b req-fc932bf8-6d75-4b6f-ac1c-a730c947591c service nova] Creating event network-vif-plugged:c4842848-d109-451e-bfa5-d8934595abaf for instance 8c1da82e-1477-4392-a5db-0113b56cf487 on hv-cinder-84984 Jul 31 18:43:00.191573 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-812c5ad5-ed00-486d-bb38-140dcec6b11b req-fc932bf8-6d75-4b6f-ac1c-a730c947591c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103430 Jul 31 18:43:00.192151 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 353/687] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:43:01.108285 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-9da59009-bad3-4d6b-a4a6-9f40e40280d5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:01.108929 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-9da59009-bad3-4d6b-a4a6-9f40e40280d5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:01.115760 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9da59009-bad3-4d6b-a4a6-9f40e40280d5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:01.116216 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9da59009-bad3-4d6b-a4a6-9f40e40280d5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:01.116994 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9da59009-bad3-4d6b-a4a6-9f40e40280d5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:01.117517 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9da59009-bad3-4d6b-a4a6-9f40e40280d5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:01.254019 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-9da59009-bad3-4d6b-a4a6-9f40e40280d5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:01.262002 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-9da59009-bad3-4d6b-a4a6-9f40e40280d5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:01.263482 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-9da59009-bad3-4d6b-a4a6-9f40e40280d5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:01.264643 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-9da59009-bad3-4d6b-a4a6-9f40e40280d5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1729 microversion: 2.20 time: 0.160691 Jul 31 18:43:01.265237 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 335/688] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:43:01 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:43:02.292655 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-bbe9ed8a-8d1d-4c6d-866c-554d8f73df60 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:02.293473 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-bbe9ed8a-8d1d-4c6d-866c-554d8f73df60 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:02.296553 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=38 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:02.300906 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-bbe9ed8a-8d1d-4c6d-866c-554d8f73df60 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:02.301365 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-bbe9ed8a-8d1d-4c6d-866c-554d8f73df60 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:02.302157 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-bbe9ed8a-8d1d-4c6d-866c-554d8f73df60 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:02.302593 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-bbe9ed8a-8d1d-4c6d-866c-554d8f73df60 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:02.443553 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-bbe9ed8a-8d1d-4c6d-866c-554d8f73df60 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:02.451948 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-bbe9ed8a-8d1d-4c6d-866c-554d8f73df60 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:02.453824 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-bbe9ed8a-8d1d-4c6d-866c-554d8f73df60 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:02.455004 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-bbe9ed8a-8d1d-4c6d-866c-554d8f73df60 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1729 microversion: 2.20 time: 0.167287 Jul 31 18:43:02.455687 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 354/689] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:43:02 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:43:03.478766 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-09516705-ba99-4d1c-bf21-639dd91cbd46 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:03.479377 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-09516705-ba99-4d1c-bf21-639dd91cbd46 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:03.486557 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-09516705-ba99-4d1c-bf21-639dd91cbd46 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:03.486998 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-09516705-ba99-4d1c-bf21-639dd91cbd46 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:03.487743 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-09516705-ba99-4d1c-bf21-639dd91cbd46 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:03.488166 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-09516705-ba99-4d1c-bf21-639dd91cbd46 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:03.628250 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-09516705-ba99-4d1c-bf21-639dd91cbd46 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:03.636502 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-09516705-ba99-4d1c-bf21-639dd91cbd46 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:03.638028 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-09516705-ba99-4d1c-bf21-639dd91cbd46 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:03.639177 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-09516705-ba99-4d1c-bf21-639dd91cbd46 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1729 microversion: 2.20 time: 0.164496 Jul 31 18:43:03.639741 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 336/690] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:43:03 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:43:04.661937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-c4e889dd-228e-48b2-b4a8-6e55cd31e699 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:04.662578 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-c4e889dd-228e-48b2-b4a8-6e55cd31e699 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:04.669534 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c4e889dd-228e-48b2-b4a8-6e55cd31e699 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:04.670074 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c4e889dd-228e-48b2-b4a8-6e55cd31e699 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:04.671016 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c4e889dd-228e-48b2-b4a8-6e55cd31e699 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:04.671449 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c4e889dd-228e-48b2-b4a8-6e55cd31e699 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:04.812089 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-c4e889dd-228e-48b2-b4a8-6e55cd31e699 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:04.820348 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-c4e889dd-228e-48b2-b4a8-6e55cd31e699 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:04.821853 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-c4e889dd-228e-48b2-b4a8-6e55cd31e699 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:04.823027 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-c4e889dd-228e-48b2-b4a8-6e55cd31e699 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1729 microversion: 2.20 time: 0.165035 Jul 31 18:43:04.823583 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 355/691] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:43:04 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:43:05.847254 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-f78393b1-d2e2-4636-b90d-e8ce0984d40f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:05.848534 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-f78393b1-d2e2-4636-b90d-e8ce0984d40f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:05.851345 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:05.858211 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f78393b1-d2e2-4636-b90d-e8ce0984d40f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:05.858830 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f78393b1-d2e2-4636-b90d-e8ce0984d40f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:05.859631 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f78393b1-d2e2-4636-b90d-e8ce0984d40f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:05.860059 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f78393b1-d2e2-4636-b90d-e8ce0984d40f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:05.992880 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-f78393b1-d2e2-4636-b90d-e8ce0984d40f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:06.000838 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-f78393b1-d2e2-4636-b90d-e8ce0984d40f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:06.002330 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-f78393b1-d2e2-4636-b90d-e8ce0984d40f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:06.003853 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-f78393b1-d2e2-4636-b90d-e8ce0984d40f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1729 microversion: 2.20 time: 0.161111 Jul 31 18:43:06.004615 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 337/692] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:43:05 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:43:07.029721 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4664ced8-d983-4bab-9bbb-79275dac5100 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:07.030260 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-4664ced8-d983-4bab-9bbb-79275dac5100 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:07.037285 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4664ced8-d983-4bab-9bbb-79275dac5100 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:07.037791 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4664ced8-d983-4bab-9bbb-79275dac5100 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:07.038631 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4664ced8-d983-4bab-9bbb-79275dac5100 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:07.039153 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4664ced8-d983-4bab-9bbb-79275dac5100 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:07.171027 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-4664ced8-d983-4bab-9bbb-79275dac5100 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:07.179310 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-4664ced8-d983-4bab-9bbb-79275dac5100 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:07.180872 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-4664ced8-d983-4bab-9bbb-79275dac5100 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:07.182059 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-4664ced8-d983-4bab-9bbb-79275dac5100 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1729 microversion: 2.20 time: 0.157024 Jul 31 18:43:07.182636 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 356/693] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:43:07 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:43:08.141854 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-9f467daa-d7b3-4b17-ad4c-f4ccd11e495d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1395501279", "imageRef": "6f2a0bb6-2fb3-4536-bee3-23e4e975f079", "flavorRef": "452", "networks": [{"uuid": "145afbfb-0dce-40b2-9a7d-dce1264ceef8"}]}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:43:08.196008 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.network.neutron [None req-9f467daa-d7b3-4b17-ad4c-f4ccd11e495d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] validate_networks() for [('145afbfb-0dce-40b2-9a7d-dce1264ceef8', None, None, None, None, None)] {{(pid=124333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 18:43:08.205753 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-35c7f74d-46ec-42a8-bbac-af59fa4aec04 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:08.206437 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-35c7f74d-46ec-42a8-bbac-af59fa4aec04 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:08.213838 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-35c7f74d-46ec-42a8-bbac-af59fa4aec04 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:08.214278 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-35c7f74d-46ec-42a8-bbac-af59fa4aec04 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:08.215038 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-35c7f74d-46ec-42a8-bbac-af59fa4aec04 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:08.215461 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-35c7f74d-46ec-42a8-bbac-af59fa4aec04 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:08.349066 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-35c7f74d-46ec-42a8-bbac-af59fa4aec04 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:08.357232 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-35c7f74d-46ec-42a8-bbac-af59fa4aec04 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:08.358739 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-35c7f74d-46ec-42a8-bbac-af59fa4aec04 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:08.359898 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-35c7f74d-46ec-42a8-bbac-af59fa4aec04 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1729 microversion: 2.20 time: 0.158017 Jul 31 18:43:08.360482 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 357/694] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:43:08 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:43:08.598171 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-9f467daa-d7b3-4b17-ad4c-f4ccd11e495d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Flavor limits 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 18:43:08.598803 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-9f467daa-d7b3-4b17-ad4c-f4ccd11e495d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Image limits 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 18:43:08.599547 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-9f467daa-d7b3-4b17-ad4c-f4ccd11e495d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Flavor pref 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 18:43:08.600141 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-9f467daa-d7b3-4b17-ad4c-f4ccd11e495d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Image pref 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 18:43:08.600742 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-9f467daa-d7b3-4b17-ad4c-f4ccd11e495d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 18:43:08.615152 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9f467daa-d7b3-4b17-ad4c-f4ccd11e495d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:08.615794 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9f467daa-d7b3-4b17-ad4c-f4ccd11e495d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:08.617034 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9f467daa-d7b3-4b17-ad4c-f4ccd11e495d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:08.617651 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9f467daa-d7b3-4b17-ad4c-f4ccd11e495d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:08.636312 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-9f467daa-d7b3-4b17-ad4c-f4ccd11e495d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Getting quotas for project 9540ab0260cc4c0ca76036b79bb5f506. Resources: {'cores', 'ram', 'instances'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:43:08.640811 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-9f467daa-d7b3-4b17-ad4c-f4ccd11e495d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Getting quotas for user f5d3517f51b74230964f1e2b29371e0b and project 9540ab0260cc4c0ca76036b79bb5f506. Resources: {'cores', 'ram', 'instances'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:43:08.653056 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-9f467daa-d7b3-4b17-ad4c-f4ccd11e495d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Going to run 1 instances... {{(pid=124333) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 18:43:08.655330 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-9f467daa-d7b3-4b17-ad4c-f4ccd11e495d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: 12510adf-5d89-4a7a-ac07-b5ff07f99092] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f2a0bb6-2fb3-4536-bee3-23e4e975f079',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 18:43:08.703588 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-9f467daa-d7b3-4b17-ad4c-f4ccd11e495d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565795 Jul 31 18:43:08.704237 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 338/695] 10.222.0.49 () {60 vars in 1147 bytes} [Sun Jul 31 18:43:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 18:43:08.716030 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-d5801063-0e34-48ec-9f2d-10d9f848a289 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:08.716636 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-d5801063-0e34-48ec-9f2d-10d9f848a289 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: 12510adf-5d89-4a7a-ac07-b5ff07f99092] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:08.773480 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-d5801063-0e34-48ec-9f2d-10d9f848a289 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:08.780704 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-d5801063-0e34-48ec-9f2d-10d9f848a289 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092" status: 200 len: 1219 microversion: 2.1 time: 0.069301 Jul 31 18:43:08.781483 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 358/696] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:08 2022] GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:43:09.386710 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-b6476bae-5a9f-4ced-89bf-9e08e445839b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:09.387697 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-b6476bae-5a9f-4ced-89bf-9e08e445839b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:09.397373 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b6476bae-5a9f-4ced-89bf-9e08e445839b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:09.398082 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b6476bae-5a9f-4ced-89bf-9e08e445839b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:09.399308 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b6476bae-5a9f-4ced-89bf-9e08e445839b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:09.400008 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b6476bae-5a9f-4ced-89bf-9e08e445839b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:09.403734 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:09.540013 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-b6476bae-5a9f-4ced-89bf-9e08e445839b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:09.548062 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-b6476bae-5a9f-4ced-89bf-9e08e445839b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:09.549565 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-b6476bae-5a9f-4ced-89bf-9e08e445839b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:09.550694 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-b6476bae-5a9f-4ced-89bf-9e08e445839b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1729 microversion: 2.20 time: 0.171213 Jul 31 18:43:09.551240 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 339/697] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:43:09 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:43:09.803908 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-2f68b7d1-bcab-44f6-853c-d39cd081d197 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:09.804484 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-2f68b7d1-bcab-44f6-853c-d39cd081d197 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: 12510adf-5d89-4a7a-ac07-b5ff07f99092] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:09.815028 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2f68b7d1-bcab-44f6-853c-d39cd081d197 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:09.815603 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2f68b7d1-bcab-44f6-853c-d39cd081d197 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:09.816717 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2f68b7d1-bcab-44f6-853c-d39cd081d197 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:09.817334 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2f68b7d1-bcab-44f6-853c-d39cd081d197 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:09.882977 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-2f68b7d1-bcab-44f6-853c-d39cd081d197 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:09.891747 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-2f68b7d1-bcab-44f6-853c-d39cd081d197 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092" status: 200 len: 1223 microversion: 2.1 time: 0.093497 Jul 31 18:43:09.893358 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 359/698] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:09 2022] GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:43:10.575867 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-ca78f36a-d6d8-4a45-abde-5a3c9d49f0aa tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:10.576566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-ca78f36a-d6d8-4a45-abde-5a3c9d49f0aa tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:10.583423 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ca78f36a-d6d8-4a45-abde-5a3c9d49f0aa tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:10.583879 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ca78f36a-d6d8-4a45-abde-5a3c9d49f0aa tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:10.584679 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ca78f36a-d6d8-4a45-abde-5a3c9d49f0aa tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:10.585149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ca78f36a-d6d8-4a45-abde-5a3c9d49f0aa tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:10.716267 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-ca78f36a-d6d8-4a45-abde-5a3c9d49f0aa tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:10.724308 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-ca78f36a-d6d8-4a45-abde-5a3c9d49f0aa tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:10.725807 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-ca78f36a-d6d8-4a45-abde-5a3c9d49f0aa tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:10.726954 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-ca78f36a-d6d8-4a45-abde-5a3c9d49f0aa tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1729 microversion: 2.20 time: 0.155158 Jul 31 18:43:10.727495 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 340/699] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:43:10 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:43:10.914288 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-52871a85-d065-4ab5-a245-6a29f79d9d02 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:10.914937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-52871a85-d065-4ab5-a245-6a29f79d9d02 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: 12510adf-5d89-4a7a-ac07-b5ff07f99092] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:10.921513 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-52871a85-d065-4ab5-a245-6a29f79d9d02 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:10.921963 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-52871a85-d065-4ab5-a245-6a29f79d9d02 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:10.922747 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-52871a85-d065-4ab5-a245-6a29f79d9d02 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:10.923174 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-52871a85-d065-4ab5-a245-6a29f79d9d02 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:10.984814 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-52871a85-d065-4ab5-a245-6a29f79d9d02 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:10.992435 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-52871a85-d065-4ab5-a245-6a29f79d9d02 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092" status: 200 len: 1289 microversion: 2.1 time: 0.082117 Jul 31 18:43:10.993255 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 360/700] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:10 2022] GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092 => generated 1289 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:43:11.331730 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-aab0a185-71b0-4d9d-b8d0-5a3c049e0b6f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:11.332218 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-aab0a185-71b0-4d9d-b8d0-5a3c049e0b6f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:11.338696 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-aab0a185-71b0-4d9d-b8d0-5a3c049e0b6f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:11.339318 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-aab0a185-71b0-4d9d-b8d0-5a3c049e0b6f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:11.340234 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-aab0a185-71b0-4d9d-b8d0-5a3c049e0b6f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:11.340692 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-aab0a185-71b0-4d9d-b8d0-5a3c049e0b6f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:11.423482 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.objects.instance [None req-aab0a185-71b0-4d9d-b8d0-5a3c049e0b6f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lazy-loading 'services' on Instance uuid 393ca02e-2618-40a8-8764-5f039ebd3345 {{(pid=124333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:43:11.499557 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-aab0a185-71b0-4d9d-b8d0-5a3c049e0b6f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "DELETE /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345/os-volume_attachments/65f92705-f08d-4aae-a75b-be9b8054e59a" status: 202 len: 0 microversion: 2.1 time: 0.171578 Jul 31 18:43:11.500141 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 341/701] 10.222.0.49 () {58 vars in 1416 bytes} [Sun Jul 31 18:43:11 2022] DELETE /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345/os-volume_attachments/65f92705-f08d-4aae-a75b-be9b8054e59a => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:43:11.511137 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-c37c77df-b39b-4f51-912f-eb475ffb622a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:11.513998 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-c37c77df-b39b-4f51-912f-eb475ffb622a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:11.521051 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c37c77df-b39b-4f51-912f-eb475ffb622a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:11.521710 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c37c77df-b39b-4f51-912f-eb475ffb622a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:11.522797 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c37c77df-b39b-4f51-912f-eb475ffb622a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:11.523222 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c37c77df-b39b-4f51-912f-eb475ffb622a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:11.559164 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-c37c77df-b39b-4f51-912f-eb475ffb622a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054141 Jul 31 18:43:11.559735 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 361/702] 10.222.0.49 () {58 vars in 1302 bytes} [Sun Jul 31 18:43:11 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:43:11.751232 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-795bf501-8246-4931-b098-c9d321947a1a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:11.751988 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-795bf501-8246-4931-b098-c9d321947a1a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:11.758875 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-795bf501-8246-4931-b098-c9d321947a1a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:11.759320 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-795bf501-8246-4931-b098-c9d321947a1a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:11.760094 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-795bf501-8246-4931-b098-c9d321947a1a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:11.760524 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-795bf501-8246-4931-b098-c9d321947a1a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:11.895934 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-795bf501-8246-4931-b098-c9d321947a1a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:11.903894 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-795bf501-8246-4931-b098-c9d321947a1a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:11.905462 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-795bf501-8246-4931-b098-c9d321947a1a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:11.906610 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-795bf501-8246-4931-b098-c9d321947a1a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1729 microversion: 2.20 time: 0.160444 Jul 31 18:43:11.907169 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 342/703] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:43:11 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:43:12.015330 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-7d078d49-aa94-4bc3-8ac5-405b9d75325d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:12.015829 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-7d078d49-aa94-4bc3-8ac5-405b9d75325d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: 12510adf-5d89-4a7a-ac07-b5ff07f99092] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:12.023973 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7d078d49-aa94-4bc3-8ac5-405b9d75325d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:12.024506 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7d078d49-aa94-4bc3-8ac5-405b9d75325d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:12.025420 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7d078d49-aa94-4bc3-8ac5-405b9d75325d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:12.025960 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7d078d49-aa94-4bc3-8ac5-405b9d75325d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:12.173151 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-7d078d49-aa94-4bc3-8ac5-405b9d75325d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:12.181882 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-7d078d49-aa94-4bc3-8ac5-405b9d75325d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092" status: 200 len: 1319 microversion: 2.1 time: 0.171413 Jul 31 18:43:12.182459 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 362/704] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:12 2022] GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:43:12.571990 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-336de00c-aa15-4ad7-a8be-e9e938ab0a0a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:12.574505 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-336de00c-aa15-4ad7-a8be-e9e938ab0a0a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:12.583185 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-336de00c-aa15-4ad7-a8be-e9e938ab0a0a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:12.584979 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-336de00c-aa15-4ad7-a8be-e9e938ab0a0a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:12.585893 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-336de00c-aa15-4ad7-a8be-e9e938ab0a0a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:12.586395 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-336de00c-aa15-4ad7-a8be-e9e938ab0a0a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:12.621153 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-336de00c-aa15-4ad7-a8be-e9e938ab0a0a tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053383 Jul 31 18:43:12.622034 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 343/705] 10.222.0.49 () {58 vars in 1302 bytes} [Sun Jul 31 18:43:12 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:43:12.829859 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-d3680a1d-c337-4f80-83b7-671f81bc21c3 req-30058221-185e-454b-a7f8-db666c5503fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12510adf-5d89-4a7a-ac07-b5ff07f99092", "tag": "524ea4aa-10b2-46f4-b7f8-682379bb10a8"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:43:12.840130 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-d3680a1d-c337-4f80-83b7-671f81bc21c3 req-30058221-185e-454b-a7f8-db666c5503fa service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:12.840645 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-d3680a1d-c337-4f80-83b7-671f81bc21c3 req-30058221-185e-454b-a7f8-db666c5503fa service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:12.851849 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-d3680a1d-c337-4f80-83b7-671f81bc21c3 req-30058221-185e-454b-a7f8-db666c5503fa service nova] Creating event network-changed:524ea4aa-10b2-46f4-b7f8-682379bb10a8 for instance 12510adf-5d89-4a7a-ac07-b5ff07f99092 on hv-cinder-84984 Jul 31 18:43:12.856918 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-d3680a1d-c337-4f80-83b7-671f81bc21c3 req-30058221-185e-454b-a7f8-db666c5503fa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163845 Jul 31 18:43:12.857676 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 363/706] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:43:12.930233 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-df5bb02a-9495-4270-83f8-94ec94e7a5e6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:12.931400 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-df5bb02a-9495-4270-83f8-94ec94e7a5e6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:12.938142 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-df5bb02a-9495-4270-83f8-94ec94e7a5e6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:12.938592 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-df5bb02a-9495-4270-83f8-94ec94e7a5e6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:12.939361 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-df5bb02a-9495-4270-83f8-94ec94e7a5e6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:12.939993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-df5bb02a-9495-4270-83f8-94ec94e7a5e6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:13.183897 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-df5bb02a-9495-4270-83f8-94ec94e7a5e6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:13.192255 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-df5bb02a-9495-4270-83f8-94ec94e7a5e6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:13.193769 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-df5bb02a-9495-4270-83f8-94ec94e7a5e6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:13.194920 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-df5bb02a-9495-4270-83f8-94ec94e7a5e6 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1716 microversion: 2.20 time: 0.268988 Jul 31 18:43:13.195459 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 344/707] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:43:12 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1716 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:43:13.213465 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-739592d6-917c-4b3e-a77e-d087f37948d3 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:13.214128 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-739592d6-917c-4b3e-a77e-d087f37948d3 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: 12510adf-5d89-4a7a-ac07-b5ff07f99092] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:13.221032 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-739592d6-917c-4b3e-a77e-d087f37948d3 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:13.221475 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-739592d6-917c-4b3e-a77e-d087f37948d3 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:13.227060 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-739592d6-917c-4b3e-a77e-d087f37948d3 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:13.227060 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-739592d6-917c-4b3e-a77e-d087f37948d3 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:13.360498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-739592d6-917c-4b3e-a77e-d087f37948d3 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:13.368354 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-739592d6-917c-4b3e-a77e-d087f37948d3 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092" status: 200 len: 1319 microversion: 2.1 time: 0.169084 Jul 31 18:43:13.368943 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 364/708] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:13 2022] GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:43:13.638385 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-90bb5ee7-aab3-4ae4-ac95-b69f5dcd9376 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:13.640681 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-90bb5ee7-aab3-4ae4-ac95-b69f5dcd9376 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:13.647157 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-90bb5ee7-aab3-4ae4-ac95-b69f5dcd9376 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:13.647600 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-90bb5ee7-aab3-4ae4-ac95-b69f5dcd9376 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:13.648349 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-90bb5ee7-aab3-4ae4-ac95-b69f5dcd9376 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:13.648793 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-90bb5ee7-aab3-4ae4-ac95-b69f5dcd9376 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:13.678320 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-90bb5ee7-aab3-4ae4-ac95-b69f5dcd9376 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046784 Jul 31 18:43:13.678856 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 345/709] 10.222.0.49 () {58 vars in 1302 bytes} [Sun Jul 31 18:43:13 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:43:14.390118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-547c7cef-4e4f-41d0-ab31-bf447181f704 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:14.391345 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-547c7cef-4e4f-41d0-ab31-bf447181f704 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: 12510adf-5d89-4a7a-ac07-b5ff07f99092] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:14.398378 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-547c7cef-4e4f-41d0-ab31-bf447181f704 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:14.398828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-547c7cef-4e4f-41d0-ab31-bf447181f704 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:14.399905 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-547c7cef-4e4f-41d0-ab31-bf447181f704 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:14.400342 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-547c7cef-4e4f-41d0-ab31-bf447181f704 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:14.530106 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-547c7cef-4e4f-41d0-ab31-bf447181f704 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:14.537767 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-547c7cef-4e4f-41d0-ab31-bf447181f704 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092" status: 200 len: 1319 microversion: 2.1 time: 0.151743 Jul 31 18:43:14.538314 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 365/710] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:14 2022] GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:43:14.694933 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-9af0ffbe-2725-4572-b828-8cf474455280 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:14.698487 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-9af0ffbe-2725-4572-b828-8cf474455280 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:14.709608 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9af0ffbe-2725-4572-b828-8cf474455280 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:14.710253 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9af0ffbe-2725-4572-b828-8cf474455280 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:14.711509 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9af0ffbe-2725-4572-b828-8cf474455280 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:14.712227 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9af0ffbe-2725-4572-b828-8cf474455280 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:14.743766 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-9af0ffbe-2725-4572-b828-8cf474455280 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055466 Jul 31 18:43:14.744317 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 346/711] 10.222.0.49 () {58 vars in 1302 bytes} [Sun Jul 31 18:43:14 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:43:15.569804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4e40afa7-c38f-43a0-a4d6-4709b9697243 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:15.570853 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-4e40afa7-c38f-43a0-a4d6-4709b9697243 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: 12510adf-5d89-4a7a-ac07-b5ff07f99092] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:15.579955 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4e40afa7-c38f-43a0-a4d6-4709b9697243 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:15.580407 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4e40afa7-c38f-43a0-a4d6-4709b9697243 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:15.581217 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4e40afa7-c38f-43a0-a4d6-4709b9697243 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:15.581652 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4e40afa7-c38f-43a0-a4d6-4709b9697243 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:15.714539 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-4e40afa7-c38f-43a0-a4d6-4709b9697243 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:15.726648 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-4e40afa7-c38f-43a0-a4d6-4709b9697243 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092" status: 200 len: 1319 microversion: 2.1 time: 0.163102 Jul 31 18:43:15.727508 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 366/712] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:15 2022] GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:43:15.757505 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-f0f2dc4e-fdcf-43e3-a66e-b1e120232a14 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:15.759659 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-f0f2dc4e-fdcf-43e3-a66e-b1e120232a14 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:15.766723 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f0f2dc4e-fdcf-43e3-a66e-b1e120232a14 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:15.767169 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f0f2dc4e-fdcf-43e3-a66e-b1e120232a14 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:15.767937 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f0f2dc4e-fdcf-43e3-a66e-b1e120232a14 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:15.768362 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f0f2dc4e-fdcf-43e3-a66e-b1e120232a14 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:15.798078 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-f0f2dc4e-fdcf-43e3-a66e-b1e120232a14 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044554 Jul 31 18:43:15.798655 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 347/713] 10.222.0.49 () {58 vars in 1302 bytes} [Sun Jul 31 18:43:15 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:43:16.750498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-8e84c20d-406a-42c5-b6fe-94608b8b8901 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:16.751311 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-8e84c20d-406a-42c5-b6fe-94608b8b8901 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: 12510adf-5d89-4a7a-ac07-b5ff07f99092] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:16.758402 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8e84c20d-406a-42c5-b6fe-94608b8b8901 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:16.758848 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8e84c20d-406a-42c5-b6fe-94608b8b8901 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:16.759604 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8e84c20d-406a-42c5-b6fe-94608b8b8901 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:16.760025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8e84c20d-406a-42c5-b6fe-94608b8b8901 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:16.810814 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-8cf6a031-291c-4a0a-b483-2dcf5d01e898 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:16.813028 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-8cf6a031-291c-4a0a-b483-2dcf5d01e898 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:16.820108 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8cf6a031-291c-4a0a-b483-2dcf5d01e898 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:16.820870 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8cf6a031-291c-4a0a-b483-2dcf5d01e898 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:16.821650 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8cf6a031-291c-4a0a-b483-2dcf5d01e898 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:16.822085 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8cf6a031-291c-4a0a-b483-2dcf5d01e898 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:16.851822 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-8cf6a031-291c-4a0a-b483-2dcf5d01e898 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045115 Jul 31 18:43:16.852393 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 348/714] 10.222.0.49 () {58 vars in 1302 bytes} [Sun Jul 31 18:43:16 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:43:16.895272 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-8e84c20d-406a-42c5-b6fe-94608b8b8901 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:16.906041 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-8e84c20d-406a-42c5-b6fe-94608b8b8901 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092" status: 200 len: 1319 microversion: 2.1 time: 0.159510 Jul 31 18:43:16.906604 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 367/715] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:16 2022] GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:43:17.864543 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-3497dd7f-828f-4113-b03e-2328b20789b5 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:17.866727 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-3497dd7f-828f-4113-b03e-2328b20789b5 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:17.874070 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3497dd7f-828f-4113-b03e-2328b20789b5 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:17.874514 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3497dd7f-828f-4113-b03e-2328b20789b5 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:17.875269 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3497dd7f-828f-4113-b03e-2328b20789b5 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:17.875691 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3497dd7f-828f-4113-b03e-2328b20789b5 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:17.905993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-3497dd7f-828f-4113-b03e-2328b20789b5 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045455 Jul 31 18:43:17.906536 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 349/716] 10.222.0.49 () {58 vars in 1302 bytes} [Sun Jul 31 18:43:17 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:43:17.927665 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-2ad58941-147d-44eb-9762-8fa62bec156f tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:17.928342 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-2ad58941-147d-44eb-9762-8fa62bec156f tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: 12510adf-5d89-4a7a-ac07-b5ff07f99092] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:17.935071 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2ad58941-147d-44eb-9762-8fa62bec156f tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:17.935514 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2ad58941-147d-44eb-9762-8fa62bec156f tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:17.936295 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2ad58941-147d-44eb-9762-8fa62bec156f tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:17.936709 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2ad58941-147d-44eb-9762-8fa62bec156f tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:18.106812 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-2ad58941-147d-44eb-9762-8fa62bec156f tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:18.114619 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-2ad58941-147d-44eb-9762-8fa62bec156f tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092" status: 200 len: 1319 microversion: 2.1 time: 0.191421 Jul 31 18:43:18.115182 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 368/717] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:17 2022] GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:43:18.178363 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-3b783d96-95d2-4559-96e3-303b9393db24 req-447c1224-1fab-4a66-8031-35c83e9b0769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12510adf-5d89-4a7a-ac07-b5ff07f99092", "name": "network-vif-plugged", "status": "completed", "tag": "524ea4aa-10b2-46f4-b7f8-682379bb10a8"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:43:18.188556 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-3b783d96-95d2-4559-96e3-303b9393db24 req-447c1224-1fab-4a66-8031-35c83e9b0769 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:18.189172 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-3b783d96-95d2-4559-96e3-303b9393db24 req-447c1224-1fab-4a66-8031-35c83e9b0769 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:18.201324 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-3b783d96-95d2-4559-96e3-303b9393db24 req-447c1224-1fab-4a66-8031-35c83e9b0769 service nova] Creating event network-vif-plugged:524ea4aa-10b2-46f4-b7f8-682379bb10a8 for instance 12510adf-5d89-4a7a-ac07-b5ff07f99092 on hv-cinder-84984 Jul 31 18:43:18.206601 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-3b783d96-95d2-4559-96e3-303b9393db24 req-447c1224-1fab-4a66-8031-35c83e9b0769 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031981 Jul 31 18:43:18.207253 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 350/718] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:43:18.314259 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f2775918-6c56-4c2b-aa87-f69ee83b1ab8 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:18.316494 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-f2775918-6c56-4c2b-aa87-f69ee83b1ab8 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:18.322928 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f2775918-6c56-4c2b-aa87-f69ee83b1ab8 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:18.323382 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f2775918-6c56-4c2b-aa87-f69ee83b1ab8 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:18.324149 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f2775918-6c56-4c2b-aa87-f69ee83b1ab8 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:18.324585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f2775918-6c56-4c2b-aa87-f69ee83b1ab8 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:18.342270 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=100 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:18.356500 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-f2775918-6c56-4c2b-aa87-f69ee83b1ab8 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046306 Jul 31 18:43:18.357099 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 369/719] 10.222.0.49 () {58 vars in 1302 bytes} [Sun Jul 31 18:43:18 2022] GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:43:18.467294 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-93778c20-eff1-4e26-b40a-19f7942324bb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:18.467866 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-93778c20-eff1-4e26-b40a-19f7942324bb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:18.474220 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-93778c20-eff1-4e26-b40a-19f7942324bb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:18.474675 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-93778c20-eff1-4e26-b40a-19f7942324bb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:18.475433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-93778c20-eff1-4e26-b40a-19f7942324bb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:18.475893 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-93778c20-eff1-4e26-b40a-19f7942324bb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:18.507303 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-93778c20-eff1-4e26-b40a-19f7942324bb tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725/os-volume_attachments/1245d73e-e4ea-470d-b58b-2686663abfab" status: 200 len: 194 microversion: 2.1 time: 0.044950 Jul 31 18:43:18.508613 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 351/720] 10.222.0.49 () {58 vars in 1413 bytes} [Sun Jul 31 18:43:18 2022] GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725/os-volume_attachments/1245d73e-e4ea-470d-b58b-2686663abfab => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:43:18.518618 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-621c7fa0-d8b7-4af1-ae81-be0a23485c8f tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:18.519120 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-621c7fa0-d8b7-4af1-ae81-be0a23485c8f tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:18.525329 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-621c7fa0-d8b7-4af1-ae81-be0a23485c8f tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:18.526038 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-621c7fa0-d8b7-4af1-ae81-be0a23485c8f tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:18.526760 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-621c7fa0-d8b7-4af1-ae81-be0a23485c8f tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:18.527248 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-621c7fa0-d8b7-4af1-ae81-be0a23485c8f tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:18.612862 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.objects.instance [None req-621c7fa0-d8b7-4af1-ae81-be0a23485c8f tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lazy-loading 'services' on Instance uuid ab4406f9-3520-44ee-97e5-a8e771410725 {{(pid=124334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:43:18.687561 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-621c7fa0-d8b7-4af1-ae81-be0a23485c8f tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725/os-volume_attachments/1245d73e-e4ea-470d-b58b-2686663abfab" status: 202 len: 0 microversion: 2.1 time: 0.172686 Jul 31 18:43:18.688144 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 370/721] 10.222.0.49 () {58 vars in 1416 bytes} [Sun Jul 31 18:43:18 2022] DELETE /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725/os-volume_attachments/1245d73e-e4ea-470d-b58b-2686663abfab => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:43:18.921495 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-09dfec7c-ab1d-460a-8b04-46ee81996df3 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:18.924797 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-09dfec7c-ab1d-460a-8b04-46ee81996df3 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:18.927773 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell0:SELECT=2 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:18.928579 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell0:SELECT=6 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:18.936745 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-09dfec7c-ab1d-460a-8b04-46ee81996df3 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:18.937226 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-09dfec7c-ab1d-460a-8b04-46ee81996df3 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:18.938066 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-09dfec7c-ab1d-460a-8b04-46ee81996df3 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:18.938481 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-09dfec7c-ab1d-460a-8b04-46ee81996df3 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:18.968436 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-09dfec7c-ab1d-460a-8b04-46ee81996df3 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053409 Jul 31 18:43:18.969011 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 352/722] 10.222.0.49 () {58 vars in 1302 bytes} [Sun Jul 31 18:43:18 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 18:43:19.028471 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell0:SELECT=2 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:19.033726 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4a322550-2bb2-401c-8393-cfb23e21d7d4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:19.034299 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-4a322550-2bb2-401c-8393-cfb23e21d7d4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:19.041081 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4a322550-2bb2-401c-8393-cfb23e21d7d4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:19.041310 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4a322550-2bb2-401c-8393-cfb23e21d7d4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:19.042056 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4a322550-2bb2-401c-8393-cfb23e21d7d4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:19.042578 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4a322550-2bb2-401c-8393-cfb23e21d7d4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:19.068062 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-4a322550-2bb2-401c-8393-cfb23e21d7d4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Going to try to terminate instance {{(pid=124334) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 18:43:19.136013 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-a0ab9489-dc79-407d-a32f-31a0428095f6 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:19.136632 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-a0ab9489-dc79-407d-a32f-31a0428095f6 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: 12510adf-5d89-4a7a-ac07-b5ff07f99092] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:19.143083 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a0ab9489-dc79-407d-a32f-31a0428095f6 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:19.143791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a0ab9489-dc79-407d-a32f-31a0428095f6 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:19.144578 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a0ab9489-dc79-407d-a32f-31a0428095f6 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:19.145055 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a0ab9489-dc79-407d-a32f-31a0428095f6 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:19.146424 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-4a322550-2bb2-401c-8393-cfb23e21d7d4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "DELETE /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345" status: 204 len: 0 microversion: 2.1 time: 0.118638 Jul 31 18:43:19.147014 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 371/723] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:43:19 2022] DELETE /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 18:43:19.155701 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4948b181-55de-4fed-8b11-46ac7024b312 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:19.156431 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-4948b181-55de-4fed-8b11-46ac7024b312 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:19.162391 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4948b181-55de-4fed-8b11-46ac7024b312 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:19.162838 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4948b181-55de-4fed-8b11-46ac7024b312 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:19.163641 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4948b181-55de-4fed-8b11-46ac7024b312 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:19.164045 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4948b181-55de-4fed-8b11-46ac7024b312 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:19.278889 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-a0ab9489-dc79-407d-a32f-31a0428095f6 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:19.287998 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-a0ab9489-dc79-407d-a32f-31a0428095f6 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092" status: 200 len: 1319 microversion: 2.1 time: 0.155879 Jul 31 18:43:19.288585 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 353/724] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:19 2022] GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:43:19.335785 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-4948b181-55de-4fed-8b11-46ac7024b312 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:19.347515 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-4948b181-55de-4fed-8b11-46ac7024b312 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345" status: 200 len: 1681 microversion: 2.1 time: 0.195619 Jul 31 18:43:19.348213 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 372/725] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:19 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345 => generated 1681 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:43:20.313164 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-4455328c-b26b-4942-b480-3b9ba19435d1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:20.314115 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-4455328c-b26b-4942-b480-3b9ba19435d1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: 12510adf-5d89-4a7a-ac07-b5ff07f99092] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:20.325332 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4455328c-b26b-4942-b480-3b9ba19435d1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:20.326208 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4455328c-b26b-4942-b480-3b9ba19435d1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:20.326976 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4455328c-b26b-4942-b480-3b9ba19435d1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:20.327401 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4455328c-b26b-4942-b480-3b9ba19435d1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:20.371635 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-fed2e0fe-d8f2-4037-89c0-a5b067920342 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:20.372312 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-fed2e0fe-d8f2-4037-89c0-a5b067920342 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:20.379537 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fed2e0fe-d8f2-4037-89c0-a5b067920342 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:20.379978 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fed2e0fe-d8f2-4037-89c0-a5b067920342 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:20.380716 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fed2e0fe-d8f2-4037-89c0-a5b067920342 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:20.381206 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fed2e0fe-d8f2-4037-89c0-a5b067920342 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:20.467684 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-4455328c-b26b-4942-b480-3b9ba19435d1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:20.475503 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-4455328c-b26b-4942-b480-3b9ba19435d1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092" status: 200 len: 1319 microversion: 2.1 time: 0.168823 Jul 31 18:43:20.476133 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 354/726] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:20 2022] GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:43:20.513019 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-fed2e0fe-d8f2-4037-89c0-a5b067920342 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:20.520752 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-fed2e0fe-d8f2-4037-89c0-a5b067920342 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345" status: 200 len: 1681 microversion: 2.1 time: 0.152970 Jul 31 18:43:20.521361 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 373/727] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:20 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:43:21.499590 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-69eb2f4f-0b44-43ee-b247-c0f3f52986f1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:21.500284 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-69eb2f4f-0b44-43ee-b247-c0f3f52986f1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: 12510adf-5d89-4a7a-ac07-b5ff07f99092] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:21.507876 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-69eb2f4f-0b44-43ee-b247-c0f3f52986f1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:21.508351 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-69eb2f4f-0b44-43ee-b247-c0f3f52986f1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:21.509171 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-69eb2f4f-0b44-43ee-b247-c0f3f52986f1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:21.509750 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-69eb2f4f-0b44-43ee-b247-c0f3f52986f1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:21.541337 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-8a4df080-1e72-475a-8827-856d861983be tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:21.542849 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-8a4df080-1e72-475a-8827-856d861983be tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:21.550198 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8a4df080-1e72-475a-8827-856d861983be tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:21.550707 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8a4df080-1e72-475a-8827-856d861983be tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:21.551538 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8a4df080-1e72-475a-8827-856d861983be tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:21.551969 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8a4df080-1e72-475a-8827-856d861983be tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:21.698663 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-8a4df080-1e72-475a-8827-856d861983be tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:21.706881 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-8a4df080-1e72-475a-8827-856d861983be tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345" status: 200 len: 1681 microversion: 2.1 time: 0.169697 Jul 31 18:43:21.707549 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 374/728] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:21 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:43:22.095945 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-69eb2f4f-0b44-43ee-b247-c0f3f52986f1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:22.098365 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:22.107923 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-69eb2f4f-0b44-43ee-b247-c0f3f52986f1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092" status: 200 len: 1508 microversion: 2.1 time: 0.614395 Jul 31 18:43:22.121923 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 355/729] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:21 2022] GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092 => generated 1508 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:43:22.729613 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-0eec4647-dd8d-4d2e-bada-b036a90552f4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:22.730500 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-0eec4647-dd8d-4d2e-bada-b036a90552f4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:22.737455 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0eec4647-dd8d-4d2e-bada-b036a90552f4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:22.737956 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0eec4647-dd8d-4d2e-bada-b036a90552f4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:22.738751 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0eec4647-dd8d-4d2e-bada-b036a90552f4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:22.739505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0eec4647-dd8d-4d2e-bada-b036a90552f4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:23.013103 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-0eec4647-dd8d-4d2e-bada-b036a90552f4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88472fa130654657af599106c6aac279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2df629457c4ff68ad061eb29cb232f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:23.021864 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-0eec4647-dd8d-4d2e-bada-b036a90552f4 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345" status: 200 len: 1613 microversion: 2.1 time: 0.296335 Jul 31 18:43:23.022136 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-3001a1bb-cf31-416f-a144-11b18454baad tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:23.023007 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 375/730] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:22 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345 => generated 1613 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:43:23.023480 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-3001a1bb-cf31-416f-a144-11b18454baad tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:23.031125 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3001a1bb-cf31-416f-a144-11b18454baad tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:23.031686 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3001a1bb-cf31-416f-a144-11b18454baad tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:23.032588 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3001a1bb-cf31-416f-a144-11b18454baad tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:23.033271 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3001a1bb-cf31-416f-a144-11b18454baad tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:23.065285 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-3001a1bb-cf31-416f-a144-11b18454baad tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725/os-volume_attachments/eec407fc-337a-49ed-9b67-11c38fff034d" status: 200 len: 194 microversion: 2.1 time: 0.047361 Jul 31 18:43:23.066324 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 356/731] 10.222.0.49 () {58 vars in 1413 bytes} [Sun Jul 31 18:43:23 2022] GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725/os-volume_attachments/eec407fc-337a-49ed-9b67-11c38fff034d => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:43:23.077715 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-d2bf2832-7eef-4c52-a2d0-1835b7891a75 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:23.078222 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-d2bf2832-7eef-4c52-a2d0-1835b7891a75 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:23.084993 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d2bf2832-7eef-4c52-a2d0-1835b7891a75 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:23.085731 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d2bf2832-7eef-4c52-a2d0-1835b7891a75 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:23.086725 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d2bf2832-7eef-4c52-a2d0-1835b7891a75 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:23.087157 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d2bf2832-7eef-4c52-a2d0-1835b7891a75 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:23.181303 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-7b71a680-2d0d-450f-af7a-9299acf6fa65 req-d1914537-4871-4c7c-9195-208c41b71619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "393ca02e-2618-40a8-8764-5f039ebd3345", "name": "network-vif-deleted", "tag": "85a54d1c-4356-47db-b52c-f53c6798c16e"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:43:23.187563 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.objects.instance [None req-d2bf2832-7eef-4c52-a2d0-1835b7891a75 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lazy-loading 'services' on Instance uuid ab4406f9-3520-44ee-97e5-a8e771410725 {{(pid=124334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:43:23.192046 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-7b71a680-2d0d-450f-af7a-9299acf6fa65 req-d1914537-4871-4c7c-9195-208c41b71619 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:23.192490 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-7b71a680-2d0d-450f-af7a-9299acf6fa65 req-d1914537-4871-4c7c-9195-208c41b71619 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:23.206837 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-7b71a680-2d0d-450f-af7a-9299acf6fa65 req-d1914537-4871-4c7c-9195-208c41b71619 service nova] Creating event network-vif-deleted:85a54d1c-4356-47db-b52c-f53c6798c16e for instance 393ca02e-2618-40a8-8764-5f039ebd3345 on hv-cinder-84984 Jul 31 18:43:23.215643 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-7b71a680-2d0d-450f-af7a-9299acf6fa65 req-d1914537-4871-4c7c-9195-208c41b71619 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037189 Jul 31 18:43:23.219604 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 357/732] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:43:23.303471 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-d2bf2832-7eef-4c52-a2d0-1835b7891a75 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725/os-volume_attachments/eec407fc-337a-49ed-9b67-11c38fff034d" status: 202 len: 0 microversion: 2.1 time: 0.230330 Jul 31 18:43:23.304462 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 376/733] 10.222.0.49 () {58 vars in 1416 bytes} [Sun Jul 31 18:43:23 2022] DELETE /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725/os-volume_attachments/eec407fc-337a-49ed-9b67-11c38fff034d => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:43:24.050236 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-39ee9c7b-2c8f-4a9b-9d40-9c40a71ab0f1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:24.051059 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-39ee9c7b-2c8f-4a9b-9d40-9c40a71ab0f1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:24.058152 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-39ee9c7b-2c8f-4a9b-9d40-9c40a71ab0f1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:24.058748 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-39ee9c7b-2c8f-4a9b-9d40-9c40a71ab0f1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:24.059638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-39ee9c7b-2c8f-4a9b-9d40-9c40a71ab0f1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:24.060220 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-39ee9c7b-2c8f-4a9b-9d40-9c40a71ab0f1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:24.074683 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-39ee9c7b-2c8f-4a9b-9d40-9c40a71ab0f1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] HTTP exception thrown: Instance 393ca02e-2618-40a8-8764-5f039ebd3345 could not be found. Jul 31 18:43:24.076433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-39ee9c7b-2c8f-4a9b-9d40-9c40a71ab0f1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Request method failure captured: Jul 31 18:43:24.076433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345 HTTP/1.1 Jul 31 18:43:24.076433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:43:24.076433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:43:24.076433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:43:24.076433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:43:24.076433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:43:24.076433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:43:24.076433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:43:24.076433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:43:24.076433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5svnCPQZeHt0IA40T23IJBlzfc_owbnP881pQWMpE8r05p0cjUmhFB7PWffkD-KRucC_Oyk8QutMV685S7HEr035rVpk89oU9HKa-wvvs-R5fBFQ0CQNEwRf6FMeK1W7edVvwFPexKLrlNGEN1GAEFVnFuiP_-qiW1e52QM8MwBKeEc Jul 31 18:43:24.076433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:43:24.076433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:43:24.076433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:43:24.076433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:43:24.076433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:43:24.076433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:43:24.076433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:43:24.076433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:24.076433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:43:24.076433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:43:24.078122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8b2df629457c4ff68ad061eb29cb232f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:43:24.078122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:24.078122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:43:24.078122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:24.078122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:43:24.078122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:43:24.078122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:43:24.078122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 88472fa130654657af599106c6aac279 Jul 31 18:43:24.078122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:43:24.078122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: > Jul 31 18:43:24.078122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Instance 393ca02e-2618-40a8-8764-5f039ebd3345 could not be found. Jul 31 18:43:24.078122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': '393ca02e-2618-40a8-8764-5f039ebd3345'} Jul 31 18:43:24.078977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:43:24.078977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:24.078977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:43:24.078977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:43:24.078977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:43:24.078977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:43:24.078977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:43:24.078977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:43:24.078977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:43:24.078977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:43:24.078977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 393ca02e-2618-40a8-8764-5f039ebd3345 could not be found. Jul 31 18:43:24.078977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:24.078977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:24.078977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:24.078977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:24.078977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:24.078977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:24.078977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:43:24.078977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:43:24.078977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:43:24.080445 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:43:24.080445 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:43:24.080445 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:43:24.080445 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:43:24.080445 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:43:24.080445 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:43:24.080445 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:43:24.080445 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 393ca02e-2618-40a8-8764-5f039ebd3345 could not be found. Jul 31 18:43:24.080445 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:24.080445 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:24.080445 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:24.080445 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:24.080445 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:24.080445 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:24.080445 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:43:24.080445 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:43:24.080445 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 393ca02e-2618-40a8-8764-5f039ebd3345 could not be found. Jul 31 18:43:24.080445 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:24.081733 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-39ee9c7b-2c8f-4a9b-9d40-9c40a71ab0f1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Returning 404 to user: Instance 393ca02e-2618-40a8-8764-5f039ebd3345 could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:43:24.081733 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-39ee9c7b-2c8f-4a9b-9d40-9c40a71ab0f1 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345" status: 404 len: 111 microversion: 2.1 time: 0.036530 Jul 31 18:43:24.084736 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 358/734] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:24 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:43:24.088080 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-c8923f64-007d-44a9-b851-6075e955865f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '.version_select at 0x7f8709abbe50>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:24.109417 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-c8923f64-007d-44a9-b851-6075e955865f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1890480947" status: 202 len: 0 microversion: 2.1 time: 0.025969 Jul 31 18:43:24.110004 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 377/735] 10.222.0.49 () {58 vars in 1221 bytes} [Sun Jul 31 18:43:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1890480947 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:43:24.515324 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-e0206a06-7307-4faa-8ebb-7e538586e7c4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:24.519154 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-e0206a06-7307-4faa-8ebb-7e538586e7c4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:24.529066 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e0206a06-7307-4faa-8ebb-7e538586e7c4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:24.529626 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e0206a06-7307-4faa-8ebb-7e538586e7c4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:24.530486 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e0206a06-7307-4faa-8ebb-7e538586e7c4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:24.531492 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e0206a06-7307-4faa-8ebb-7e538586e7c4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:24.561961 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-e0206a06-7307-4faa-8ebb-7e538586e7c4 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052380 Jul 31 18:43:24.562488 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 359/736] 10.222.0.49 () {58 vars in 1302 bytes} [Sun Jul 31 18:43:24 2022] GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 18:43:24.689373 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-248c551c-91c9-4819-a143-5d11d0d6db3e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:24.692466 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-248c551c-91c9-4819-a143-5d11d0d6db3e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:24.705134 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-248c551c-91c9-4819-a143-5d11d0d6db3e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:24.705521 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-248c551c-91c9-4819-a143-5d11d0d6db3e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:24.706590 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-248c551c-91c9-4819-a143-5d11d0d6db3e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:24.706946 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-248c551c-91c9-4819-a143-5d11d0d6db3e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:24.743576 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-248c551c-91c9-4819-a143-5d11d0d6db3e tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060347 Jul 31 18:43:24.744168 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 378/737] 10.222.0.49 () {58 vars in 1302 bytes} [Sun Jul 31 18:43:24 2022] GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 18:43:24.811012 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-f45f5d13-fa7f-4c9e-a705-4cc3c2ee0080 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:24.811012 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-f45f5d13-fa7f-4c9e-a705-4cc3c2ee0080 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:24.816633 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f45f5d13-fa7f-4c9e-a705-4cc3c2ee0080 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:24.817109 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f45f5d13-fa7f-4c9e-a705-4cc3c2ee0080 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:24.817944 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f45f5d13-fa7f-4c9e-a705-4cc3c2ee0080 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:24.818292 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f45f5d13-fa7f-4c9e-a705-4cc3c2ee0080 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:24.843388 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-f45f5d13-fa7f-4c9e-a705-4cc3c2ee0080 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Going to try to terminate instance {{(pid=124333) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 18:43:24.929625 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-f45f5d13-fa7f-4c9e-a705-4cc3c2ee0080 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725" status: 204 len: 0 microversion: 2.1 time: 0.123839 Jul 31 18:43:24.930337 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 360/738] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:43:24 2022] DELETE /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 18:43:24.939112 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-02479d5b-b22d-452b-ae6a-70428e3221d9 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:24.939725 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-02479d5b-b22d-452b-ae6a-70428e3221d9 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:24.945907 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-02479d5b-b22d-452b-ae6a-70428e3221d9 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:24.946355 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-02479d5b-b22d-452b-ae6a-70428e3221d9 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:24.947119 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-02479d5b-b22d-452b-ae6a-70428e3221d9 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:24.947553 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-02479d5b-b22d-452b-ae6a-70428e3221d9 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:25.102756 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-02479d5b-b22d-452b-ae6a-70428e3221d9 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:25.110540 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-02479d5b-b22d-452b-ae6a-70428e3221d9 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725" status: 200 len: 1672 microversion: 2.1 time: 0.175444 Jul 31 18:43:25.111100 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 379/739] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:24 2022] GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725 => generated 1672 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:43:25.952119 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-a1c890a3-9ae4-499f-9e1a-e4eb03fb4905 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:25.952740 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-a1c890a3-9ae4-499f-9e1a-e4eb03fb4905 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:25.960322 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a1c890a3-9ae4-499f-9e1a-e4eb03fb4905 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:25.960810 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a1c890a3-9ae4-499f-9e1a-e4eb03fb4905 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:25.961575 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a1c890a3-9ae4-499f-9e1a-e4eb03fb4905 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:25.962012 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a1c890a3-9ae4-499f-9e1a-e4eb03fb4905 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:25.975751 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-a1c890a3-9ae4-499f-9e1a-e4eb03fb4905 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] HTTP exception thrown: Instance 393ca02e-2618-40a8-8764-5f039ebd3345 could not be found. Jul 31 18:43:25.977466 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-a1c890a3-9ae4-499f-9e1a-e4eb03fb4905 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Request method failure captured: Jul 31 18:43:25.977466 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: DELETE /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345 HTTP/1.1 Jul 31 18:43:25.977466 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:43:25.977466 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:43:25.977466 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:43:25.977466 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:43:25.977466 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:43:25.977466 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:43:25.977466 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:43:25.977466 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:43:25.977466 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5svnCPQZeHt0IA40T23IJBlzfc_owbnP881pQWMpE8r05p0cjUmhFB7PWffkD-KRucC_Oyk8QutMV685S7HEr035rVpk89oU9HKa-wvvs-R5fBFQ0CQNEwRf6FMeK1W7edVvwFPexKLrlNGEN1GAEFVnFuiP_-qiW1e52QM8MwBKeEc Jul 31 18:43:25.977466 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:43:25.977466 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:43:25.977466 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:43:25.977466 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:43:25.977466 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:43:25.977466 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:43:25.977466 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:43:25.977466 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:25.977466 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:43:25.977466 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:43:25.978955 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8b2df629457c4ff68ad061eb29cb232f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:43:25.978955 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:25.978955 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:43:25.978955 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:25.978955 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:43:25.978955 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:43:25.978955 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:43:25.978955 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 88472fa130654657af599106c6aac279 Jul 31 18:43:25.978955 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:43:25.978955 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: > Jul 31 18:43:25.978955 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Instance 393ca02e-2618-40a8-8764-5f039ebd3345 could not be found. Jul 31 18:43:25.978955 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': '393ca02e-2618-40a8-8764-5f039ebd3345'} Jul 31 18:43:25.979743 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:43:25.979743 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:25.979743 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:43:25.979743 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:43:25.979743 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:43:25.979743 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:43:25.979743 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:43:25.979743 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:43:25.979743 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:43:25.979743 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:43:25.979743 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 393ca02e-2618-40a8-8764-5f039ebd3345 could not be found. Jul 31 18:43:25.979743 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:25.979743 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:25.979743 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:25.979743 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:25.979743 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:25.979743 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:25.979743 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:43:25.979743 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:43:25.979743 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:43:25.981214 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:43:25.981214 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 18:43:25.981214 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 18:43:25.981214 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 18:43:25.981214 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 18:43:25.981214 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:43:25.981214 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:43:25.981214 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:43:25.981214 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:43:25.981214 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 393ca02e-2618-40a8-8764-5f039ebd3345 could not be found. Jul 31 18:43:25.981214 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:25.981214 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:25.981214 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:25.981214 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:25.981214 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:25.981214 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:25.981214 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:43:25.981214 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:43:25.981214 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 393ca02e-2618-40a8-8764-5f039ebd3345 could not be found. Jul 31 18:43:25.981214 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:25.982667 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-a1c890a3-9ae4-499f-9e1a-e4eb03fb4905 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Returning 404 to user: Instance 393ca02e-2618-40a8-8764-5f039ebd3345 could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:43:25.982667 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-a1c890a3-9ae4-499f-9e1a-e4eb03fb4905 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "DELETE /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345" status: 404 len: 111 microversion: 2.1 time: 0.031648 Jul 31 18:43:25.982667 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 361/740] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:43:25 2022] DELETE /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:43:25.987669 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-5ed92b9a-ba86-4acf-92c7-c3a8444f40e8 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:25.988276 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-5ed92b9a-ba86-4acf-92c7-c3a8444f40e8 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 393ca02e-2618-40a8-8764-5f039ebd3345] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:25.994752 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5ed92b9a-ba86-4acf-92c7-c3a8444f40e8 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:25.995191 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5ed92b9a-ba86-4acf-92c7-c3a8444f40e8 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:25.995943 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5ed92b9a-ba86-4acf-92c7-c3a8444f40e8 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:25.996367 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5ed92b9a-ba86-4acf-92c7-c3a8444f40e8 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:26.011610 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-5ed92b9a-ba86-4acf-92c7-c3a8444f40e8 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] HTTP exception thrown: Instance 393ca02e-2618-40a8-8764-5f039ebd3345 could not be found. Jul 31 18:43:26.013384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-5ed92b9a-ba86-4acf-92c7-c3a8444f40e8 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Request method failure captured: Jul 31 18:43:26.013384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345 HTTP/1.1 Jul 31 18:43:26.013384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:43:26.013384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:43:26.013384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:43:26.013384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 0 Jul 31 18:43:26.013384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:43:26.013384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:43:26.013384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:43:26.013384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:43:26.013384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5svnCPQZeHt0IA40T23IJBlzfc_owbnP881pQWMpE8r05p0cjUmhFB7PWffkD-KRucC_Oyk8QutMV685S7HEr035rVpk89oU9HKa-wvvs-R5fBFQ0CQNEwRf6FMeK1W7edVvwFPexKLrlNGEN1GAEFVnFuiP_-qiW1e52QM8MwBKeEc Jul 31 18:43:26.013384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:43:26.013384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:43:26.013384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:43:26.013384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:43:26.013384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:43:26.013384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:43:26.013384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:43:26.013384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:26.013384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:43:26.013384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:43:26.014821 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8b2df629457c4ff68ad061eb29cb232f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:43:26.014821 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:26.014821 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:43:26.014821 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:26.014821 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:43:26.014821 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:43:26.014821 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:43:26.014821 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: 88472fa130654657af599106c6aac279 Jul 31 18:43:26.014821 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:43:26.014821 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: > Jul 31 18:43:26.014821 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Instance 393ca02e-2618-40a8-8764-5f039ebd3345 could not be found. Jul 31 18:43:26.014821 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'id': '393ca02e-2618-40a8-8764-5f039ebd3345'} Jul 31 18:43:26.015698 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:43:26.015698 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:26.015698 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:43:26.015698 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:43:26.015698 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:43:26.015698 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:43:26.015698 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:43:26.015698 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:43:26.015698 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:43:26.015698 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:43:26.015698 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 393ca02e-2618-40a8-8764-5f039ebd3345 could not be found. Jul 31 18:43:26.015698 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:26.015698 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:26.015698 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:26.015698 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:26.015698 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:26.015698 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:26.015698 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:43:26.015698 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:43:26.015698 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:43:26.017118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:43:26.017118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:43:26.017118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:43:26.017118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:43:26.017118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:43:26.017118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:43:26.017118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:43:26.017118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 393ca02e-2618-40a8-8764-5f039ebd3345 could not be found. Jul 31 18:43:26.017118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:26.017118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:26.017118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:26.017118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:26.017118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:26.017118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:26.017118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:43:26.017118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:43:26.017118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 393ca02e-2618-40a8-8764-5f039ebd3345 could not be found. Jul 31 18:43:26.017118 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:26.018433 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-5ed92b9a-ba86-4acf-92c7-c3a8444f40e8 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Returning 404 to user: Instance 393ca02e-2618-40a8-8764-5f039ebd3345 could not be found. {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:43:26.018433 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-5ed92b9a-ba86-4acf-92c7-c3a8444f40e8 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345" status: 404 len: 111 microversion: 2.1 time: 0.030966 Jul 31 18:43:26.018433 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 380/741] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:25 2022] GET /compute/v2.1/servers/393ca02e-2618-40a8-8764-5f039ebd3345 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:43:26.133307 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-a321fb58-8776-4bc6-af15-b8da7dbb82df tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:26.133926 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-a321fb58-8776-4bc6-af15-b8da7dbb82df tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:26.140352 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a321fb58-8776-4bc6-af15-b8da7dbb82df tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:26.140819 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a321fb58-8776-4bc6-af15-b8da7dbb82df tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:26.141584 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a321fb58-8776-4bc6-af15-b8da7dbb82df tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:26.142017 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a321fb58-8776-4bc6-af15-b8da7dbb82df tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:26.276191 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-a321fb58-8776-4bc6-af15-b8da7dbb82df tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:26.284859 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-a321fb58-8776-4bc6-af15-b8da7dbb82df tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725" status: 200 len: 1672 microversion: 2.1 time: 0.155447 Jul 31 18:43:26.288585 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 362/742] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:26 2022] GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:43:27.161361 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-fdd476a5-5f29-4330-b3b5-e5cc2eea1e38 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:27.161960 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-fdd476a5-5f29-4330-b3b5-e5cc2eea1e38 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:27.169650 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fdd476a5-5f29-4330-b3b5-e5cc2eea1e38 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:27.170099 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fdd476a5-5f29-4330-b3b5-e5cc2eea1e38 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:27.170868 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fdd476a5-5f29-4330-b3b5-e5cc2eea1e38 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:27.171265 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fdd476a5-5f29-4330-b3b5-e5cc2eea1e38 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:27.184942 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-fdd476a5-5f29-4330-b3b5-e5cc2eea1e38 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] HTTP exception thrown: Instance 41338c87-271c-46dc-ba86-88a04da9ac47 could not be found. Jul 31 18:43:27.186596 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-fdd476a5-5f29-4330-b3b5-e5cc2eea1e38 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Request method failure captured: Jul 31 18:43:27.186596 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: DELETE /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47 HTTP/1.1 Jul 31 18:43:27.186596 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:43:27.186596 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:43:27.186596 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:43:27.186596 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 0 Jul 31 18:43:27.186596 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:43:27.186596 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:43:27.186596 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:43:27.186596 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:43:27.186596 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5svnCPQZeHt0IA40T23IJBlzfc_owbnP881pQWMpE8r05p0cjUmhFB7PWffkD-KRucC_Oyk8QutMV685S7HEr035rVpk89oU9HKa-wvvs-R5fBFQ0CQNEwRf6FMeK1W7edVvwFPexKLrlNGEN1GAEFVnFuiP_-qiW1e52QM8MwBKeEc Jul 31 18:43:27.186596 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:43:27.186596 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:43:27.186596 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:43:27.186596 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:43:27.186596 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:43:27.186596 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:43:27.186596 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:43:27.186596 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:27.186596 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:43:27.186596 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:43:27.188442 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8b2df629457c4ff68ad061eb29cb232f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:43:27.188442 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:27.188442 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:43:27.188442 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:27.188442 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:43:27.188442 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:43:27.188442 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:43:27.188442 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: 88472fa130654657af599106c6aac279 Jul 31 18:43:27.188442 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:43:27.188442 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: > Jul 31 18:43:27.188442 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Instance 41338c87-271c-46dc-ba86-88a04da9ac47 could not be found. Jul 31 18:43:27.188442 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'id': '41338c87-271c-46dc-ba86-88a04da9ac47'} Jul 31 18:43:27.189268 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:43:27.189268 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:27.189268 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:43:27.189268 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:43:27.189268 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:43:27.189268 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:43:27.189268 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:43:27.189268 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:43:27.189268 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:43:27.189268 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:43:27.189268 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41338c87-271c-46dc-ba86-88a04da9ac47 could not be found. Jul 31 18:43:27.189268 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:27.189268 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:27.189268 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:27.189268 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:27.189268 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:27.189268 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:27.189268 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:43:27.189268 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:43:27.189268 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:43:27.190610 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:43:27.190610 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 18:43:27.190610 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 18:43:27.190610 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 18:43:27.190610 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 18:43:27.190610 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:43:27.190610 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:43:27.190610 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:43:27.190610 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:43:27.190610 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41338c87-271c-46dc-ba86-88a04da9ac47 could not be found. Jul 31 18:43:27.190610 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:27.190610 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:27.190610 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:27.190610 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:27.190610 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:27.190610 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:27.190610 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:43:27.190610 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:43:27.190610 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41338c87-271c-46dc-ba86-88a04da9ac47 could not be found. Jul 31 18:43:27.190610 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:27.192111 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-fdd476a5-5f29-4330-b3b5-e5cc2eea1e38 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Returning 404 to user: Instance 41338c87-271c-46dc-ba86-88a04da9ac47 could not be found. {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:43:27.192111 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-fdd476a5-5f29-4330-b3b5-e5cc2eea1e38 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "DELETE /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47" status: 404 len: 111 microversion: 2.1 time: 0.030535 Jul 31 18:43:27.192111 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 381/743] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:43:27 2022] DELETE /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:43:27.197206 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-9c548e44-ef2f-4157-8316-0b531418a796 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:27.198130 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-9c548e44-ef2f-4157-8316-0b531418a796 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 41338c87-271c-46dc-ba86-88a04da9ac47] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:27.204799 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9c548e44-ef2f-4157-8316-0b531418a796 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:27.205305 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9c548e44-ef2f-4157-8316-0b531418a796 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:27.206157 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9c548e44-ef2f-4157-8316-0b531418a796 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:27.206658 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9c548e44-ef2f-4157-8316-0b531418a796 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:27.222011 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-9c548e44-ef2f-4157-8316-0b531418a796 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] HTTP exception thrown: Instance 41338c87-271c-46dc-ba86-88a04da9ac47 could not be found. Jul 31 18:43:27.223718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-9c548e44-ef2f-4157-8316-0b531418a796 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Request method failure captured: Jul 31 18:43:27.223718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47 HTTP/1.1 Jul 31 18:43:27.223718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:43:27.223718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:43:27.223718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:43:27.223718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:43:27.223718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:43:27.223718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:43:27.223718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:43:27.223718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:43:27.223718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5svnCPQZeHt0IA40T23IJBlzfc_owbnP881pQWMpE8r05p0cjUmhFB7PWffkD-KRucC_Oyk8QutMV685S7HEr035rVpk89oU9HKa-wvvs-R5fBFQ0CQNEwRf6FMeK1W7edVvwFPexKLrlNGEN1GAEFVnFuiP_-qiW1e52QM8MwBKeEc Jul 31 18:43:27.223718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:43:27.223718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:43:27.223718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:43:27.223718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:43:27.223718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:43:27.223718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:43:27.223718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:43:27.223718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:27.223718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:43:27.223718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:43:27.225089 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8b2df629457c4ff68ad061eb29cb232f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:43:27.225089 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:27.225089 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:43:27.225089 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:27.225089 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:43:27.225089 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:43:27.225089 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:43:27.225089 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 88472fa130654657af599106c6aac279 Jul 31 18:43:27.225089 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:43:27.225089 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: > Jul 31 18:43:27.225089 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Instance 41338c87-271c-46dc-ba86-88a04da9ac47 could not be found. Jul 31 18:43:27.225089 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': '41338c87-271c-46dc-ba86-88a04da9ac47'} Jul 31 18:43:27.226399 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:43:27.226399 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:27.226399 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:43:27.226399 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:43:27.226399 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:43:27.226399 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:43:27.226399 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:43:27.226399 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:43:27.226399 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:43:27.226399 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:43:27.226399 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41338c87-271c-46dc-ba86-88a04da9ac47 could not be found. Jul 31 18:43:27.226399 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:27.226399 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:27.226399 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:27.226399 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:27.226399 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:27.226399 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:27.226399 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:43:27.226399 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:43:27.226399 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:43:27.228470 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:43:27.228470 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:43:27.228470 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:43:27.228470 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:43:27.228470 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:43:27.228470 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:43:27.228470 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:43:27.228470 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41338c87-271c-46dc-ba86-88a04da9ac47 could not be found. Jul 31 18:43:27.228470 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:27.228470 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:27.228470 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:27.228470 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:27.228470 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:27.228470 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:27.228470 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:43:27.228470 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:43:27.228470 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41338c87-271c-46dc-ba86-88a04da9ac47 could not be found. Jul 31 18:43:27.228470 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:27.229722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-9c548e44-ef2f-4157-8316-0b531418a796 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Returning 404 to user: Instance 41338c87-271c-46dc-ba86-88a04da9ac47 could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:43:27.229722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-9c548e44-ef2f-4157-8316-0b531418a796 tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47" status: 404 len: 111 microversion: 2.1 time: 0.033217 Jul 31 18:43:27.229722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 363/744] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:27 2022] GET /compute/v2.1/servers/41338c87-271c-46dc-ba86-88a04da9ac47 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:43:27.235090 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-37f79f2b-221a-4d96-b907-352994cb024d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:27.235601 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-37f79f2b-221a-4d96-b907-352994cb024d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 8ccfba99-9116-4274-a24e-1615c1a661fa] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:27.242283 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-37f79f2b-221a-4d96-b907-352994cb024d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:27.242731 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-37f79f2b-221a-4d96-b907-352994cb024d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:27.243487 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-37f79f2b-221a-4d96-b907-352994cb024d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:27.243926 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-37f79f2b-221a-4d96-b907-352994cb024d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:27.265028 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-37f79f2b-221a-4d96-b907-352994cb024d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] HTTP exception thrown: Instance 8ccfba99-9116-4274-a24e-1615c1a661fa could not be found. Jul 31 18:43:27.266585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-37f79f2b-221a-4d96-b907-352994cb024d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Request method failure captured: Jul 31 18:43:27.266585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: DELETE /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa HTTP/1.1 Jul 31 18:43:27.266585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:43:27.266585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:43:27.266585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:43:27.266585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 0 Jul 31 18:43:27.266585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:43:27.266585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:43:27.266585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:43:27.266585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:43:27.266585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5svnCPQZeHt0IA40T23IJBlzfc_owbnP881pQWMpE8r05p0cjUmhFB7PWffkD-KRucC_Oyk8QutMV685S7HEr035rVpk89oU9HKa-wvvs-R5fBFQ0CQNEwRf6FMeK1W7edVvwFPexKLrlNGEN1GAEFVnFuiP_-qiW1e52QM8MwBKeEc Jul 31 18:43:27.266585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:43:27.266585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:43:27.266585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:43:27.266585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:43:27.266585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:43:27.266585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:43:27.266585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:43:27.266585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:27.266585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:43:27.266585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:43:27.268068 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8b2df629457c4ff68ad061eb29cb232f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:43:27.268068 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:27.268068 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:43:27.268068 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:27.268068 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:43:27.268068 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:43:27.268068 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:43:27.268068 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: 88472fa130654657af599106c6aac279 Jul 31 18:43:27.268068 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:43:27.268068 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: > Jul 31 18:43:27.268068 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Instance 8ccfba99-9116-4274-a24e-1615c1a661fa could not be found. Jul 31 18:43:27.268068 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'id': '8ccfba99-9116-4274-a24e-1615c1a661fa'} Jul 31 18:43:27.271950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:43:27.271950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:27.271950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:43:27.271950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:43:27.271950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:43:27.271950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:43:27.271950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:43:27.271950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:43:27.271950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:43:27.271950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:43:27.271950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ccfba99-9116-4274-a24e-1615c1a661fa could not be found. Jul 31 18:43:27.271950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:27.271950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:27.271950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:27.271950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:27.271950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:27.271950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:27.271950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:43:27.271950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:43:27.271950 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:43:27.273335 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:43:27.273335 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 18:43:27.273335 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 18:43:27.273335 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 18:43:27.273335 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 18:43:27.273335 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:43:27.273335 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:43:27.273335 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:43:27.273335 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:43:27.273335 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ccfba99-9116-4274-a24e-1615c1a661fa could not be found. Jul 31 18:43:27.273335 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:27.273335 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:27.273335 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:27.273335 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:27.273335 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:27.273335 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:27.273335 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:43:27.273335 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:43:27.273335 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ccfba99-9116-4274-a24e-1615c1a661fa could not be found. Jul 31 18:43:27.273335 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:27.274573 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-37f79f2b-221a-4d96-b907-352994cb024d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Returning 404 to user: Instance 8ccfba99-9116-4274-a24e-1615c1a661fa could not be found. {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:43:27.274573 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-37f79f2b-221a-4d96-b907-352994cb024d tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa" status: 404 len: 111 microversion: 2.1 time: 0.036832 Jul 31 18:43:27.274573 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 382/745] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:43:27 2022] DELETE /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:43:27.277191 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-e5f9061f-d6fe-4eb3-abe1-14ca0ccff0ba tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:27.277892 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-e5f9061f-d6fe-4eb3-abe1-14ca0ccff0ba tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: 8ccfba99-9116-4274-a24e-1615c1a661fa] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:27.284329 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e5f9061f-d6fe-4eb3-abe1-14ca0ccff0ba tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:27.284794 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e5f9061f-d6fe-4eb3-abe1-14ca0ccff0ba tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:27.285579 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e5f9061f-d6fe-4eb3-abe1-14ca0ccff0ba tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:27.286011 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e5f9061f-d6fe-4eb3-abe1-14ca0ccff0ba tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:27.300397 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-e5f9061f-d6fe-4eb3-abe1-14ca0ccff0ba tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] HTTP exception thrown: Instance 8ccfba99-9116-4274-a24e-1615c1a661fa could not be found. Jul 31 18:43:27.301993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-e5f9061f-d6fe-4eb3-abe1-14ca0ccff0ba tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Request method failure captured: Jul 31 18:43:27.301993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa HTTP/1.1 Jul 31 18:43:27.301993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:43:27.301993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:43:27.301993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:43:27.301993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:43:27.301993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:43:27.301993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:43:27.301993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:43:27.301993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:43:27.301993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5svnCPQZeHt0IA40T23IJBlzfc_owbnP881pQWMpE8r05p0cjUmhFB7PWffkD-KRucC_Oyk8QutMV685S7HEr035rVpk89oU9HKa-wvvs-R5fBFQ0CQNEwRf6FMeK1W7edVvwFPexKLrlNGEN1GAEFVnFuiP_-qiW1e52QM8MwBKeEc Jul 31 18:43:27.301993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:43:27.301993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:43:27.301993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:43:27.301993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:43:27.301993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:43:27.301993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:43:27.301993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:43:27.301993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:27.301993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:43:27.301993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:43:27.303252 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8b2df629457c4ff68ad061eb29cb232f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:43:27.303252 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:27.303252 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:43:27.303252 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:27.303252 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:43:27.303252 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:43:27.303252 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:43:27.303252 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 88472fa130654657af599106c6aac279 Jul 31 18:43:27.303252 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:43:27.303252 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: > Jul 31 18:43:27.303252 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Instance 8ccfba99-9116-4274-a24e-1615c1a661fa could not be found. Jul 31 18:43:27.303252 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': '8ccfba99-9116-4274-a24e-1615c1a661fa'} Jul 31 18:43:27.303976 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:43:27.303976 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:27.303976 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:43:27.303976 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:43:27.303976 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:43:27.303976 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:43:27.303976 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:43:27.303976 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:43:27.303976 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:43:27.303976 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:43:27.303976 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ccfba99-9116-4274-a24e-1615c1a661fa could not be found. Jul 31 18:43:27.303976 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:27.303976 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:27.303976 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:27.303976 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:27.303976 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:27.303976 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:27.303976 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:43:27.303976 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:43:27.303976 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:43:27.305188 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:43:27.305188 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:43:27.305188 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:43:27.305188 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:43:27.305188 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:43:27.305188 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:43:27.305188 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:43:27.305188 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ccfba99-9116-4274-a24e-1615c1a661fa could not be found. Jul 31 18:43:27.305188 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:27.305188 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:27.305188 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:27.305188 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:27.305188 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:27.305188 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:27.305188 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:43:27.305188 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:43:27.305188 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ccfba99-9116-4274-a24e-1615c1a661fa could not be found. Jul 31 18:43:27.305188 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:27.306263 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-e5f9061f-d6fe-4eb3-abe1-14ca0ccff0ba tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Returning 404 to user: Instance 8ccfba99-9116-4274-a24e-1615c1a661fa could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:43:27.306263 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-e5f9061f-d6fe-4eb3-abe1-14ca0ccff0ba tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa" status: 404 len: 111 microversion: 2.1 time: 0.030492 Jul 31 18:43:27.306263 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 364/746] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:27 2022] GET /compute/v2.1/servers/8ccfba99-9116-4274-a24e-1615c1a661fa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:43:27.307537 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4c69270d-80fa-46b0-888e-ea7a159d8237 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:27.307537 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-4c69270d-80fa-46b0-888e-ea7a159d8237 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:27.314580 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4c69270d-80fa-46b0-888e-ea7a159d8237 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:27.315186 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4c69270d-80fa-46b0-888e-ea7a159d8237 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:27.317364 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4c69270d-80fa-46b0-888e-ea7a159d8237 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:27.317962 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4c69270d-80fa-46b0-888e-ea7a159d8237 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:27.473124 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-4c69270d-80fa-46b0-888e-ea7a159d8237 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc88d9b0bc743119dcb7dc2fa8fdcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4113d291354d99b2591289639ec248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:43:27.480785 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-4c69270d-80fa-46b0-888e-ea7a159d8237 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725" status: 200 len: 1672 microversion: 2.1 time: 0.178106 Jul 31 18:43:27.481344 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 383/747] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:27 2022] GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725 => generated 1672 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:43:27.814481 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-10eca3a7-b785-4ee2-966c-02a99675e772 req-dea2d5ae-8b4c-42a8-a605-ed7567e7b1e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab4406f9-3520-44ee-97e5-a8e771410725", "name": "network-vif-deleted", "tag": "bbec5fa0-b83a-4ba1-8489-baa07b7934ef"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:43:27.825207 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-10eca3a7-b785-4ee2-966c-02a99675e772 req-dea2d5ae-8b4c-42a8-a605-ed7567e7b1e3 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:27.825612 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-10eca3a7-b785-4ee2-966c-02a99675e772 req-dea2d5ae-8b4c-42a8-a605-ed7567e7b1e3 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:27.838532 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-10eca3a7-b785-4ee2-966c-02a99675e772 req-dea2d5ae-8b4c-42a8-a605-ed7567e7b1e3 service nova] Creating event network-vif-deleted:bbec5fa0-b83a-4ba1-8489-baa07b7934ef for instance ab4406f9-3520-44ee-97e5-a8e771410725 on hv-cinder-84984 Jul 31 18:43:27.843322 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-10eca3a7-b785-4ee2-966c-02a99675e772 req-dea2d5ae-8b4c-42a8-a605-ed7567e7b1e3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032587 Jul 31 18:43:27.843926 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 365/748] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:43:28.470371 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-0d27e003-7f11-49c8-bfe1-ce099b72f57e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:28.471006 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-0d27e003-7f11-49c8-bfe1-ce099b72f57e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:28.477749 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0d27e003-7f11-49c8-bfe1-ce099b72f57e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:28.478607 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0d27e003-7f11-49c8-bfe1-ce099b72f57e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:28.479608 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0d27e003-7f11-49c8-bfe1-ce099b72f57e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:28.480307 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0d27e003-7f11-49c8-bfe1-ce099b72f57e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:28.495505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-0d27e003-7f11-49c8-bfe1-ce099b72f57e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] HTTP exception thrown: Instance f0eb4664-6cc5-455b-909b-ed8a7f69fd8e could not be found. Jul 31 18:43:28.497302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-0d27e003-7f11-49c8-bfe1-ce099b72f57e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Request method failure captured: Jul 31 18:43:28.497302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: DELETE /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e HTTP/1.1 Jul 31 18:43:28.497302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:43:28.497302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:43:28.497302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:43:28.497302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 0 Jul 31 18:43:28.497302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:43:28.497302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:43:28.497302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:43:28.497302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:43:28.497302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5svnCPQZeHt0IA40T23IJBlzfc_owbnP881pQWMpE8r05p0cjUmhFB7PWffkD-KRucC_Oyk8QutMV685S7HEr035rVpk89oU9HKa-wvvs-R5fBFQ0CQNEwRf6FMeK1W7edVvwFPexKLrlNGEN1GAEFVnFuiP_-qiW1e52QM8MwBKeEc Jul 31 18:43:28.497302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:43:28.497302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:43:28.497302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:43:28.497302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:43:28.497302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:43:28.497302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:43:28.497302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:43:28.497302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:28.497302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:43:28.497302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:43:28.498749 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8b2df629457c4ff68ad061eb29cb232f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:43:28.498749 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:28.498749 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:43:28.498749 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:28.498749 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:43:28.498749 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:43:28.498749 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:43:28.498749 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: 88472fa130654657af599106c6aac279 Jul 31 18:43:28.498749 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:43:28.498749 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: > Jul 31 18:43:28.498749 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Instance f0eb4664-6cc5-455b-909b-ed8a7f69fd8e could not be found. Jul 31 18:43:28.498749 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'id': 'f0eb4664-6cc5-455b-909b-ed8a7f69fd8e'} Jul 31 18:43:28.499567 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:43:28.499567 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:28.499567 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:43:28.499567 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:43:28.499567 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:43:28.499567 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:43:28.499567 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:43:28.499567 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:43:28.499567 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:43:28.499567 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:43:28.499567 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0eb4664-6cc5-455b-909b-ed8a7f69fd8e could not be found. Jul 31 18:43:28.499567 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:28.499567 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:28.499567 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:28.499567 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:28.499567 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:28.499567 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:28.499567 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:43:28.499567 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:43:28.499567 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:43:28.500804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:43:28.500804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 18:43:28.500804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 18:43:28.500804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 18:43:28.500804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 18:43:28.500804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:43:28.500804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:43:28.500804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:43:28.500804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:43:28.500804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0eb4664-6cc5-455b-909b-ed8a7f69fd8e could not be found. Jul 31 18:43:28.500804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:28.500804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:28.500804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:28.500804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:28.500804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:28.500804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:28.500804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:43:28.500804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:43:28.500804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0eb4664-6cc5-455b-909b-ed8a7f69fd8e could not be found. Jul 31 18:43:28.500804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:28.502187 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-0d27e003-7f11-49c8-bfe1-ce099b72f57e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Returning 404 to user: Instance f0eb4664-6cc5-455b-909b-ed8a7f69fd8e could not be found. {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:43:28.502187 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-0d27e003-7f11-49c8-bfe1-ce099b72f57e tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 404 len: 111 microversion: 2.1 time: 0.032374 Jul 31 18:43:28.502187 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 384/749] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:43:28 2022] DELETE /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:43:28.509822 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-ec68a6bb-e68e-47eb-b5cd-7454ba3fff1f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:28.510489 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-ec68a6bb-e68e-47eb-b5cd-7454ba3fff1f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] [instance: f0eb4664-6cc5-455b-909b-ed8a7f69fd8e] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:28.510677 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-b3eacb2e-32e3-4d66-8163-5f0b99d9d684 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:28.511548 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-b3eacb2e-32e3-4d66-8163-5f0b99d9d684 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:28.516542 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ec68a6bb-e68e-47eb-b5cd-7454ba3fff1f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:28.517016 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ec68a6bb-e68e-47eb-b5cd-7454ba3fff1f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:28.517760 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ec68a6bb-e68e-47eb-b5cd-7454ba3fff1f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:28.518362 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ec68a6bb-e68e-47eb-b5cd-7454ba3fff1f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:28.518917 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b3eacb2e-32e3-4d66-8163-5f0b99d9d684 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:28.519452 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b3eacb2e-32e3-4d66-8163-5f0b99d9d684 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:28.520361 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b3eacb2e-32e3-4d66-8163-5f0b99d9d684 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:28.520924 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b3eacb2e-32e3-4d66-8163-5f0b99d9d684 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:28.532692 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-ec68a6bb-e68e-47eb-b5cd-7454ba3fff1f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] HTTP exception thrown: Instance f0eb4664-6cc5-455b-909b-ed8a7f69fd8e could not be found. Jul 31 18:43:28.534247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-ec68a6bb-e68e-47eb-b5cd-7454ba3fff1f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Request method failure captured: Jul 31 18:43:28.534247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e HTTP/1.1 Jul 31 18:43:28.534247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:43:28.534247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:43:28.534247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:43:28.534247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 0 Jul 31 18:43:28.534247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:43:28.534247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:43:28.534247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:43:28.534247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:43:28.534247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5svnCPQZeHt0IA40T23IJBlzfc_owbnP881pQWMpE8r05p0cjUmhFB7PWffkD-KRucC_Oyk8QutMV685S7HEr035rVpk89oU9HKa-wvvs-R5fBFQ0CQNEwRf6FMeK1W7edVvwFPexKLrlNGEN1GAEFVnFuiP_-qiW1e52QM8MwBKeEc Jul 31 18:43:28.534247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:43:28.534247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:43:28.534247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:43:28.534247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:43:28.534247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:43:28.534247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:43:28.534247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:43:28.534247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:28.534247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:43:28.534247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:43:28.535841 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8b2df629457c4ff68ad061eb29cb232f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2df629457c4ff68ad061eb29cb232f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:43:28.535841 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:28.535841 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: 8b2df629457c4ff68ad061eb29cb232f Jul 31 18:43:28.535841 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1424040415 Jul 31 18:43:28.535841 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:43:28.535841 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:43:28.535841 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:43:28.535841 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: 88472fa130654657af599106c6aac279 Jul 31 18:43:28.535841 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-AttachVolumeNegativeTest-1424040415-project Jul 31 18:43:28.535841 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: > Jul 31 18:43:28.535841 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Instance f0eb4664-6cc5-455b-909b-ed8a7f69fd8e could not be found. Jul 31 18:43:28.535841 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'id': 'f0eb4664-6cc5-455b-909b-ed8a7f69fd8e'} Jul 31 18:43:28.536974 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:43:28.536974 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:28.536974 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:43:28.536974 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:43:28.536974 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:43:28.536974 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:43:28.536974 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:43:28.536974 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:43:28.536974 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:43:28.536974 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:43:28.536974 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0eb4664-6cc5-455b-909b-ed8a7f69fd8e could not be found. Jul 31 18:43:28.536974 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:28.536974 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:28.536974 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:28.536974 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:28.536974 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:28.536974 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:28.536974 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:43:28.536974 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:43:28.536974 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:43:28.538413 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:43:28.538413 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:43:28.538413 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:43:28.538413 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:43:28.538413 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:43:28.538413 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:43:28.538413 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:43:28.538413 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0eb4664-6cc5-455b-909b-ed8a7f69fd8e could not be found. Jul 31 18:43:28.538413 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:28.538413 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:28.538413 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:28.538413 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:28.538413 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:28.538413 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:28.538413 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:43:28.538413 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:43:28.538413 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0eb4664-6cc5-455b-909b-ed8a7f69fd8e could not be found. Jul 31 18:43:28.538413 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:28.539635 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-ec68a6bb-e68e-47eb-b5cd-7454ba3fff1f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] Returning 404 to user: Instance f0eb4664-6cc5-455b-909b-ed8a7f69fd8e could not be found. {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:43:28.539635 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-ec68a6bb-e68e-47eb-b5cd-7454ba3fff1f tempest-AttachVolumeNegativeTest-1424040415 tempest-AttachVolumeNegativeTest-1424040415-project] 10.222.0.49 "GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e" status: 404 len: 111 microversion: 2.1 time: 0.029733 Jul 31 18:43:28.541728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-b3eacb2e-32e3-4d66-8163-5f0b99d9d684 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] HTTP exception thrown: Instance ab4406f9-3520-44ee-97e5-a8e771410725 could not be found. Jul 31 18:43:28.541728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-b3eacb2e-32e3-4d66-8163-5f0b99d9d684 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Request method failure captured: Jul 31 18:43:28.541728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725 HTTP/1.1 Jul 31 18:43:28.541728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:43:28.541728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:43:28.541728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:43:28.541728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:43:28.541728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:43:28.541728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:43:28.541728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:43:28.541728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:43:28.541728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5svk5OD1ixXzGs7zky5gJpPAZfHtDEc9nf6moA_YRFWpu4h0oC7yspay74xaznK8IuBSFbxpAlC6ELtoYuYOlxb0nJAJ82PIwjSrwAP-xYHcLkH8IRi6nU_YxNycqlZiVZGdMV8m7zBmGAtl6vsCegoLpuEx28hRlP9EB6Ryyv9nVyY Jul 31 18:43:28.541728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:43:28.541728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:43:28.541728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:43:28.541728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:43:28.541728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:43:28.541728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:43:28.541728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: fc4113d291354d99b2591289639ec248 Jul 31 18:43:28.541728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-AttachVolumeTestJSON-2009046575 Jul 31 18:43:28.541728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:43:28.541728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:43:28.543555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc4113d291354d99b2591289639ec248"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fc4113d291354d99b2591289639ec248", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fc4113d291354d99b2591289639ec248"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc4113d291354d99b2591289639ec248"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:43:28.543555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-AttachVolumeTestJSON-2009046575 Jul 31 18:43:28.543555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: fc4113d291354d99b2591289639ec248 Jul 31 18:43:28.543555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2009046575 Jul 31 18:43:28.543555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-AttachVolumeTestJSON-2009046575-project Jul 31 18:43:28.543555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:43:28.543555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:43:28.543555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 4dc88d9b0bc743119dcb7dc2fa8fdcd6 Jul 31 18:43:28.543555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-AttachVolumeTestJSON-2009046575-project Jul 31 18:43:28.543555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: > Jul 31 18:43:28.543555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Instance ab4406f9-3520-44ee-97e5-a8e771410725 could not be found. Jul 31 18:43:28.543555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': 'ab4406f9-3520-44ee-97e5-a8e771410725'} Jul 31 18:43:28.544419 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:43:28.544419 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:28.544419 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:43:28.544419 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:43:28.544419 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:43:28.544419 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:43:28.544419 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:43:28.544419 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:43:28.544419 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:43:28.544419 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:43:28.544419 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab4406f9-3520-44ee-97e5-a8e771410725 could not be found. Jul 31 18:43:28.544419 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:28.544419 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:28.544419 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:28.544419 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:28.544419 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:28.544419 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:28.544419 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:43:28.544419 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:43:28.544419 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:43:28.546007 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:43:28.546007 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:43:28.546007 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:43:28.546007 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:43:28.546007 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:43:28.546007 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:43:28.546007 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:43:28.546007 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab4406f9-3520-44ee-97e5-a8e771410725 could not be found. Jul 31 18:43:28.546007 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:28.546007 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:28.546007 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:28.546007 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:28.546007 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:28.546007 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:28.546007 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:43:28.546007 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:43:28.546007 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab4406f9-3520-44ee-97e5-a8e771410725 could not be found. Jul 31 18:43:28.546007 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:28.547235 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-b3eacb2e-32e3-4d66-8163-5f0b99d9d684 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Returning 404 to user: Instance ab4406f9-3520-44ee-97e5-a8e771410725 could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:43:28.547235 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-b3eacb2e-32e3-4d66-8163-5f0b99d9d684 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725" status: 404 len: 111 microversion: 2.1 time: 0.038778 Jul 31 18:43:28.547399 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 385/750] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:28 2022] GET /compute/v2.1/servers/f0eb4664-6cc5-455b-909b-ed8a7f69fd8e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:43:28.547493 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 366/751] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:28 2022] GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:43:28.551961 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-adcdc237-388f-4542-94e3-4fe7cb347393 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '.version_select at 0x7f87097929d0>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:28.575995 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-adcdc237-388f-4542-94e3-4fe7cb347393 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-155337625" status: 202 len: 0 microversion: 2.1 time: 0.027919 Jul 31 18:43:28.577210 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 386/752] 10.222.0.49 () {58 vars in 1218 bytes} [Sun Jul 31 18:43:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-155337625 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 18:43:31.746746 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-2fa20553-6ea6-4737-91a2-45bb065c37a9 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:31.747290 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-2fa20553-6ea6-4737-91a2-45bb065c37a9 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:31.757068 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2fa20553-6ea6-4737-91a2-45bb065c37a9 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:31.757510 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2fa20553-6ea6-4737-91a2-45bb065c37a9 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:31.758316 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2fa20553-6ea6-4737-91a2-45bb065c37a9 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:31.758711 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2fa20553-6ea6-4737-91a2-45bb065c37a9 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:31.772688 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-2fa20553-6ea6-4737-91a2-45bb065c37a9 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] HTTP exception thrown: Instance ab4406f9-3520-44ee-97e5-a8e771410725 could not be found. Jul 31 18:43:31.774398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-2fa20553-6ea6-4737-91a2-45bb065c37a9 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Request method failure captured: Jul 31 18:43:31.774398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: DELETE /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725 HTTP/1.1 Jul 31 18:43:31.774398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:43:31.774398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:43:31.774398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:43:31.774398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:43:31.774398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:43:31.774398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:43:31.774398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:43:31.774398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:43:31.774398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5svk5OD1ixXzGs7zky5gJpPAZfHtDEc9nf6moA_YRFWpu4h0oC7yspay74xaznK8IuBSFbxpAlC6ELtoYuYOlxb0nJAJ82PIwjSrwAP-xYHcLkH8IRi6nU_YxNycqlZiVZGdMV8m7zBmGAtl6vsCegoLpuEx28hRlP9EB6Ryyv9nVyY Jul 31 18:43:31.774398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:43:31.774398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:43:31.774398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:43:31.774398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:43:31.774398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:43:31.774398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:43:31.774398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: fc4113d291354d99b2591289639ec248 Jul 31 18:43:31.774398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-AttachVolumeTestJSON-2009046575 Jul 31 18:43:31.774398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:43:31.774398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:43:31.775866 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc4113d291354d99b2591289639ec248"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fc4113d291354d99b2591289639ec248", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fc4113d291354d99b2591289639ec248"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc4113d291354d99b2591289639ec248"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:43:31.775866 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-AttachVolumeTestJSON-2009046575 Jul 31 18:43:31.775866 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: fc4113d291354d99b2591289639ec248 Jul 31 18:43:31.775866 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2009046575 Jul 31 18:43:31.775866 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-AttachVolumeTestJSON-2009046575-project Jul 31 18:43:31.775866 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:43:31.775866 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:43:31.775866 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 4dc88d9b0bc743119dcb7dc2fa8fdcd6 Jul 31 18:43:31.775866 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-AttachVolumeTestJSON-2009046575-project Jul 31 18:43:31.775866 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: > Jul 31 18:43:31.775866 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Instance ab4406f9-3520-44ee-97e5-a8e771410725 could not be found. Jul 31 18:43:31.775866 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': 'ab4406f9-3520-44ee-97e5-a8e771410725'} Jul 31 18:43:31.776566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:43:31.776566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:31.776566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:43:31.776566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:43:31.776566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:43:31.776566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:43:31.776566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:43:31.776566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:43:31.776566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:43:31.776566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:43:31.776566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab4406f9-3520-44ee-97e5-a8e771410725 could not be found. Jul 31 18:43:31.776566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:31.776566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:31.776566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:31.776566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:31.776566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:31.776566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:31.776566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:43:31.776566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:43:31.776566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:43:31.777753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:43:31.777753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 18:43:31.777753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 18:43:31.777753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 18:43:31.777753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 18:43:31.777753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:43:31.777753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:43:31.777753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:43:31.777753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:43:31.777753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab4406f9-3520-44ee-97e5-a8e771410725 could not be found. Jul 31 18:43:31.777753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:31.777753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:31.777753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:31.777753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:31.777753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:31.777753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:31.777753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:43:31.777753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:43:31.777753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab4406f9-3520-44ee-97e5-a8e771410725 could not be found. Jul 31 18:43:31.777753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:31.779001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-2fa20553-6ea6-4737-91a2-45bb065c37a9 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Returning 404 to user: Instance ab4406f9-3520-44ee-97e5-a8e771410725 could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:43:31.779001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-2fa20553-6ea6-4737-91a2-45bb065c37a9 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725" status: 404 len: 111 microversion: 2.1 time: 0.032936 Jul 31 18:43:31.779001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 367/753] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:43:31 2022] DELETE /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:43:31.786057 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-a6b43ba0-d0b3-4272-a947-6d2ba0a2dfdd tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:31.786668 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-a6b43ba0-d0b3-4272-a947-6d2ba0a2dfdd tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: ab4406f9-3520-44ee-97e5-a8e771410725] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:31.794099 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a6b43ba0-d0b3-4272-a947-6d2ba0a2dfdd tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:31.794598 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a6b43ba0-d0b3-4272-a947-6d2ba0a2dfdd tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:31.795380 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a6b43ba0-d0b3-4272-a947-6d2ba0a2dfdd tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:31.795808 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a6b43ba0-d0b3-4272-a947-6d2ba0a2dfdd tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:31.809991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-a6b43ba0-d0b3-4272-a947-6d2ba0a2dfdd tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] HTTP exception thrown: Instance ab4406f9-3520-44ee-97e5-a8e771410725 could not be found. Jul 31 18:43:31.811782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-a6b43ba0-d0b3-4272-a947-6d2ba0a2dfdd tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Request method failure captured: Jul 31 18:43:31.811782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725 HTTP/1.1 Jul 31 18:43:31.811782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:43:31.811782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:43:31.811782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:43:31.811782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 0 Jul 31 18:43:31.811782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:43:31.811782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:43:31.811782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:43:31.811782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:43:31.811782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5svk5OD1ixXzGs7zky5gJpPAZfHtDEc9nf6moA_YRFWpu4h0oC7yspay74xaznK8IuBSFbxpAlC6ELtoYuYOlxb0nJAJ82PIwjSrwAP-xYHcLkH8IRi6nU_YxNycqlZiVZGdMV8m7zBmGAtl6vsCegoLpuEx28hRlP9EB6Ryyv9nVyY Jul 31 18:43:31.811782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:43:31.811782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:43:31.811782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:43:31.811782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:43:31.811782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:43:31.811782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:43:31.811782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: fc4113d291354d99b2591289639ec248 Jul 31 18:43:31.811782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-AttachVolumeTestJSON-2009046575 Jul 31 18:43:31.811782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:43:31.811782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:43:31.813350 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc4113d291354d99b2591289639ec248"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fc4113d291354d99b2591289639ec248", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fc4113d291354d99b2591289639ec248"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc4113d291354d99b2591289639ec248"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:43:31.813350 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-AttachVolumeTestJSON-2009046575 Jul 31 18:43:31.813350 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: fc4113d291354d99b2591289639ec248 Jul 31 18:43:31.813350 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2009046575 Jul 31 18:43:31.813350 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-AttachVolumeTestJSON-2009046575-project Jul 31 18:43:31.813350 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:43:31.813350 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:43:31.813350 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: 4dc88d9b0bc743119dcb7dc2fa8fdcd6 Jul 31 18:43:31.813350 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-AttachVolumeTestJSON-2009046575-project Jul 31 18:43:31.813350 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: > Jul 31 18:43:31.813350 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Instance ab4406f9-3520-44ee-97e5-a8e771410725 could not be found. Jul 31 18:43:31.813350 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'id': 'ab4406f9-3520-44ee-97e5-a8e771410725'} Jul 31 18:43:31.814133 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:43:31.814133 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:31.814133 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:43:31.814133 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:43:31.814133 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:43:31.814133 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:43:31.814133 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:43:31.814133 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:43:31.814133 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:43:31.814133 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:43:31.814133 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab4406f9-3520-44ee-97e5-a8e771410725 could not be found. Jul 31 18:43:31.814133 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:31.814133 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:31.814133 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:31.814133 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:31.814133 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:31.814133 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:31.814133 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:43:31.814133 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:43:31.814133 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:43:31.815269 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:43:31.815269 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:43:31.815269 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:43:31.815269 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:43:31.815269 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:43:31.815269 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:43:31.815269 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:43:31.815269 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab4406f9-3520-44ee-97e5-a8e771410725 could not be found. Jul 31 18:43:31.815269 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:31.815269 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:31.815269 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:31.815269 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:31.815269 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:31.815269 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:31.815269 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:43:31.815269 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:43:31.815269 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab4406f9-3520-44ee-97e5-a8e771410725 could not be found. Jul 31 18:43:31.815269 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:31.816406 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-a6b43ba0-d0b3-4272-a947-6d2ba0a2dfdd tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Returning 404 to user: Instance ab4406f9-3520-44ee-97e5-a8e771410725 could not be found. {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:43:31.816406 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-a6b43ba0-d0b3-4272-a947-6d2ba0a2dfdd tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725" status: 404 len: 111 microversion: 2.1 time: 0.032348 Jul 31 18:43:31.816406 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 387/754] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:31 2022] GET /compute/v2.1/servers/ab4406f9-3520-44ee-97e5-a8e771410725 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:43:32.985574 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-6b55a84d-6d4f-4ae5-80fc-4d2f8d5cd3f5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:32.986108 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-6b55a84d-6d4f-4ae5-80fc-4d2f8d5cd3f5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:32.995157 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6b55a84d-6d4f-4ae5-80fc-4d2f8d5cd3f5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:32.995600 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6b55a84d-6d4f-4ae5-80fc-4d2f8d5cd3f5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:32.996365 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6b55a84d-6d4f-4ae5-80fc-4d2f8d5cd3f5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:32.996878 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6b55a84d-6d4f-4ae5-80fc-4d2f8d5cd3f5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:33.012756 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-6b55a84d-6d4f-4ae5-80fc-4d2f8d5cd3f5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] HTTP exception thrown: Instance a1577f8a-0f79-4b82-9afa-85c86f07cf92 could not be found. Jul 31 18:43:33.014429 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-6b55a84d-6d4f-4ae5-80fc-4d2f8d5cd3f5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Request method failure captured: Jul 31 18:43:33.014429 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: DELETE /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 HTTP/1.1 Jul 31 18:43:33.014429 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:43:33.014429 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:43:33.014429 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:43:33.014429 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:43:33.014429 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:43:33.014429 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:43:33.014429 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:43:33.014429 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:43:33.014429 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5svk5OD1ixXzGs7zky5gJpPAZfHtDEc9nf6moA_YRFWpu4h0oC7yspay74xaznK8IuBSFbxpAlC6ELtoYuYOlxb0nJAJ82PIwjSrwAP-xYHcLkH8IRi6nU_YxNycqlZiVZGdMV8m7zBmGAtl6vsCegoLpuEx28hRlP9EB6Ryyv9nVyY Jul 31 18:43:33.014429 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:43:33.014429 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:43:33.014429 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:43:33.014429 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:43:33.014429 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:43:33.014429 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:43:33.014429 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: fc4113d291354d99b2591289639ec248 Jul 31 18:43:33.014429 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-AttachVolumeTestJSON-2009046575 Jul 31 18:43:33.014429 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:43:33.014429 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:43:33.015922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc4113d291354d99b2591289639ec248"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fc4113d291354d99b2591289639ec248", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fc4113d291354d99b2591289639ec248"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc4113d291354d99b2591289639ec248"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:43:33.015922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-AttachVolumeTestJSON-2009046575 Jul 31 18:43:33.015922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: fc4113d291354d99b2591289639ec248 Jul 31 18:43:33.015922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2009046575 Jul 31 18:43:33.015922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-AttachVolumeTestJSON-2009046575-project Jul 31 18:43:33.015922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:43:33.015922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:43:33.015922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 4dc88d9b0bc743119dcb7dc2fa8fdcd6 Jul 31 18:43:33.015922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-AttachVolumeTestJSON-2009046575-project Jul 31 18:43:33.015922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: > Jul 31 18:43:33.015922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Instance a1577f8a-0f79-4b82-9afa-85c86f07cf92 could not be found. Jul 31 18:43:33.015922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': 'a1577f8a-0f79-4b82-9afa-85c86f07cf92'} Jul 31 18:43:33.016783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:43:33.016783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:33.016783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:43:33.016783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:43:33.016783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:43:33.016783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:43:33.016783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:43:33.016783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:43:33.016783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:43:33.016783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:43:33.016783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1577f8a-0f79-4b82-9afa-85c86f07cf92 could not be found. Jul 31 18:43:33.016783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:33.016783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:33.016783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:33.016783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:33.016783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:33.016783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:33.016783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:43:33.016783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:43:33.016783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:43:33.018149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:43:33.018149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 18:43:33.018149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 18:43:33.018149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 18:43:33.018149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 18:43:33.018149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:43:33.018149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:43:33.018149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:43:33.018149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:43:33.018149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1577f8a-0f79-4b82-9afa-85c86f07cf92 could not be found. Jul 31 18:43:33.018149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:33.018149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:33.018149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:33.018149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:33.018149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:33.018149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:33.018149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:43:33.018149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:43:33.018149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1577f8a-0f79-4b82-9afa-85c86f07cf92 could not be found. Jul 31 18:43:33.018149 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:43:33.019512 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-6b55a84d-6d4f-4ae5-80fc-4d2f8d5cd3f5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Returning 404 to user: Instance a1577f8a-0f79-4b82-9afa-85c86f07cf92 could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:43:33.019512 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-6b55a84d-6d4f-4ae5-80fc-4d2f8d5cd3f5 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 404 len: 111 microversion: 2.1 time: 0.034184 Jul 31 18:43:33.019512 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 368/755] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:43:32 2022] DELETE /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:43:33.025990 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-8f233305-0571-4586-b7ff-6043118daa17 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:43:33.026702 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-8f233305-0571-4586-b7ff-6043118daa17 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] [instance: a1577f8a-0f79-4b82-9afa-85c86f07cf92] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:33.029562 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:33.034876 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8f233305-0571-4586-b7ff-6043118daa17 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:33.035316 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8f233305-0571-4586-b7ff-6043118daa17 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:33.036113 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8f233305-0571-4586-b7ff-6043118daa17 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:33.036543 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8f233305-0571-4586-b7ff-6043118daa17 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:33.051645 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-8f233305-0571-4586-b7ff-6043118daa17 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] HTTP exception thrown: Instance a1577f8a-0f79-4b82-9afa-85c86f07cf92 could not be found. Jul 31 18:43:33.053200 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-8f233305-0571-4586-b7ff-6043118daa17 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Request method failure captured: Jul 31 18:43:33.053200 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 HTTP/1.1 Jul 31 18:43:33.053200 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:43:33.053200 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:43:33.053200 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:43:33.053200 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 0 Jul 31 18:43:33.053200 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:43:33.053200 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:43:33.053200 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:43:33.053200 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:43:33.053200 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5svk5OD1ixXzGs7zky5gJpPAZfHtDEc9nf6moA_YRFWpu4h0oC7yspay74xaznK8IuBSFbxpAlC6ELtoYuYOlxb0nJAJ82PIwjSrwAP-xYHcLkH8IRi6nU_YxNycqlZiVZGdMV8m7zBmGAtl6vsCegoLpuEx28hRlP9EB6Ryyv9nVyY Jul 31 18:43:33.053200 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:43:33.053200 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:43:33.053200 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:43:33.053200 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:43:33.053200 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:43:33.053200 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:43:33.053200 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: fc4113d291354d99b2591289639ec248 Jul 31 18:43:33.053200 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-AttachVolumeTestJSON-2009046575 Jul 31 18:43:33.053200 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:43:33.053200 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:43:33.054963 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc4113d291354d99b2591289639ec248"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fc4113d291354d99b2591289639ec248", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fc4113d291354d99b2591289639ec248"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc4113d291354d99b2591289639ec248"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:43:33.054963 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-AttachVolumeTestJSON-2009046575 Jul 31 18:43:33.054963 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: fc4113d291354d99b2591289639ec248 Jul 31 18:43:33.054963 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2009046575 Jul 31 18:43:33.054963 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-AttachVolumeTestJSON-2009046575-project Jul 31 18:43:33.054963 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:43:33.054963 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:43:33.054963 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: 4dc88d9b0bc743119dcb7dc2fa8fdcd6 Jul 31 18:43:33.054963 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-AttachVolumeTestJSON-2009046575-project Jul 31 18:43:33.054963 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: > Jul 31 18:43:33.054963 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Instance a1577f8a-0f79-4b82-9afa-85c86f07cf92 could not be found. Jul 31 18:43:33.054963 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'id': 'a1577f8a-0f79-4b82-9afa-85c86f07cf92'} Jul 31 18:43:33.056025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:43:33.056025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:33.056025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:43:33.056025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:43:33.056025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:43:33.056025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:43:33.056025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:43:33.056025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:43:33.056025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:43:33.056025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:43:33.056025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1577f8a-0f79-4b82-9afa-85c86f07cf92 could not be found. Jul 31 18:43:33.056025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:33.056025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:33.056025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:33.056025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:33.056025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:33.056025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:33.056025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:43:33.056025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:43:33.056025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:43:33.057644 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:43:33.057644 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:43:33.057644 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:43:33.057644 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:43:33.057644 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:43:33.057644 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:43:33.057644 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:43:33.057644 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1577f8a-0f79-4b82-9afa-85c86f07cf92 could not be found. Jul 31 18:43:33.057644 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:33.057644 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:43:33.057644 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:33.057644 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:43:33.057644 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:43:33.057644 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:43:33.057644 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:43:33.057644 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:43:33.057644 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1577f8a-0f79-4b82-9afa-85c86f07cf92 could not be found. Jul 31 18:43:33.057644 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:43:33.058873 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-8f233305-0571-4586-b7ff-6043118daa17 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] Returning 404 to user: Instance a1577f8a-0f79-4b82-9afa-85c86f07cf92 could not be found. {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:43:33.058873 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-8f233305-0571-4586-b7ff-6043118daa17 tempest-AttachVolumeTestJSON-2009046575 tempest-AttachVolumeTestJSON-2009046575-project] 10.222.0.49 "GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92" status: 404 len: 111 microversion: 2.1 time: 0.033806 Jul 31 18:43:33.058873 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 388/756] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:43:33 2022] GET /compute/v2.1/servers/a1577f8a-0f79-4b82-9afa-85c86f07cf92 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:43:41.634454 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-323084fd-21ff-493a-abd2-ec95ed116816 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1bde4f09-fe5c-4b34-a069-1b4f4675bcc1", "device": "/dev/sdb"}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:43:41.637292 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-323084fd-21ff-493a-abd2-ec95ed116816 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: 12510adf-5d89-4a7a-ac07-b5ff07f99092] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:43:41.639448 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:43:41.645790 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-323084fd-21ff-493a-abd2-ec95ed116816 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:41.646279 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-323084fd-21ff-493a-abd2-ec95ed116816 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:41.647089 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-323084fd-21ff-493a-abd2-ec95ed116816 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:43:41.647524 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-323084fd-21ff-493a-abd2-ec95ed116816 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:43:41.902616 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-323084fd-21ff-493a-abd2-ec95ed116816 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "POST /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272073 Jul 31 18:43:41.903262 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 369/757] 10.222.0.49 () {60 vars in 1323 bytes} [Sun Jul 31 18:43:41 2022] POST /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:44:01.366455 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4579b466-4de6-4b43-8dd4-64f868d193d3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:01.368597 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-4579b466-4de6-4b43-8dd4-64f868d193d3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:01.370931 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:01.376411 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4579b466-4de6-4b43-8dd4-64f868d193d3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:01.376888 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4579b466-4de6-4b43-8dd4-64f868d193d3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:01.378004 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4579b466-4de6-4b43-8dd4-64f868d193d3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:01.378428 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4579b466-4de6-4b43-8dd4-64f868d193d3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:01.407621 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-4579b466-4de6-4b43-8dd4-64f868d193d3 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046819 Jul 31 18:44:01.408156 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 389/758] 10.222.0.49 () {60 vars in 1343 bytes} [Sun Jul 31 18:44:01 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:44:01.470899 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=1 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:01.471959 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:01.476493 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-f15b0676-1ab1-45a9-a452-ff20e2f8606e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:01.477174 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-f15b0676-1ab1-45a9-a452-ff20e2f8606e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:01.484468 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f15b0676-1ab1-45a9-a452-ff20e2f8606e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:01.484959 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f15b0676-1ab1-45a9-a452-ff20e2f8606e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:01.485954 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f15b0676-1ab1-45a9-a452-ff20e2f8606e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:01.486391 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f15b0676-1ab1-45a9-a452-ff20e2f8606e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:01.512511 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-f15b0676-1ab1-45a9-a452-ff20e2f8606e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Going to try to terminate instance {{(pid=124333) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 18:44:01.592224 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-f15b0676-1ab1-45a9-a452-ff20e2f8606e tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 204 len: 0 microversion: 2.20 time: 0.123557 Jul 31 18:44:01.596016 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 370/759] 10.222.0.49 () {60 vars in 1280 bytes} [Sun Jul 31 18:44:01 2022] DELETE /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 18:44:01.601481 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-e28aa9ea-7f75-4e3b-a09b-3b4a6188029b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:01.602150 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-e28aa9ea-7f75-4e3b-a09b-3b4a6188029b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:01.608527 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e28aa9ea-7f75-4e3b-a09b-3b4a6188029b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:01.609043 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e28aa9ea-7f75-4e3b-a09b-3b4a6188029b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:01.609991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e28aa9ea-7f75-4e3b-a09b-3b4a6188029b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:01.610464 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e28aa9ea-7f75-4e3b-a09b-3b4a6188029b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:01.747873 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-e28aa9ea-7f75-4e3b-a09b-3b4a6188029b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:01.756610 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-e28aa9ea-7f75-4e3b-a09b-3b4a6188029b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:01.758112 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-e28aa9ea-7f75-4e3b-a09b-3b4a6188029b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:01.759266 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-e28aa9ea-7f75-4e3b-a09b-3b4a6188029b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1722 microversion: 2.20 time: 0.161796 Jul 31 18:44:01.759821 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 390/760] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:44:01 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:44:02.787671 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-4ccb2022-6814-4ed0-8455-f5ed4f41d643 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:02.788814 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-4ccb2022-6814-4ed0-8455-f5ed4f41d643 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:02.799737 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4ccb2022-6814-4ed0-8455-f5ed4f41d643 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:02.800474 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4ccb2022-6814-4ed0-8455-f5ed4f41d643 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:02.801709 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4ccb2022-6814-4ed0-8455-f5ed4f41d643 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:02.802140 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4ccb2022-6814-4ed0-8455-f5ed4f41d643 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:02.947605 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-4ccb2022-6814-4ed0-8455-f5ed4f41d643 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:02.955606 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-4ccb2022-6814-4ed0-8455-f5ed4f41d643 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:02.957111 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-4ccb2022-6814-4ed0-8455-f5ed4f41d643 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:02.958349 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-4ccb2022-6814-4ed0-8455-f5ed4f41d643 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1722 microversion: 2.20 time: 0.177891 Jul 31 18:44:02.958899 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 371/761] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:44:02 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:44:03.985300 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-e843ef06-2750-44fb-a3f1-df9f1ec6e751 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:03.986300 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-e843ef06-2750-44fb-a3f1-df9f1ec6e751 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:03.997472 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e843ef06-2750-44fb-a3f1-df9f1ec6e751 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:03.998213 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e843ef06-2750-44fb-a3f1-df9f1ec6e751 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:03.999470 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e843ef06-2750-44fb-a3f1-df9f1ec6e751 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:04.000187 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-e843ef06-2750-44fb-a3f1-df9f1ec6e751 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:04.136391 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-e843ef06-2750-44fb-a3f1-df9f1ec6e751 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:04.144405 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-e843ef06-2750-44fb-a3f1-df9f1ec6e751 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:04.145917 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-e843ef06-2750-44fb-a3f1-df9f1ec6e751 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:04.147159 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-e843ef06-2750-44fb-a3f1-df9f1ec6e751 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1722 microversion: 2.20 time: 0.168483 Jul 31 18:44:04.147681 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 391/762] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:44:03 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:44:04.731827 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-ac2221a8-f973-401a-bfde-54f8b82435e2 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:04.732332 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-ac2221a8-f973-401a-bfde-54f8b82435e2 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: 12510adf-5d89-4a7a-ac07-b5ff07f99092] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:04.739142 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ac2221a8-f973-401a-bfde-54f8b82435e2 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:04.739585 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ac2221a8-f973-401a-bfde-54f8b82435e2 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:04.740345 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ac2221a8-f973-401a-bfde-54f8b82435e2 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:04.740782 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ac2221a8-f973-401a-bfde-54f8b82435e2 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:04.830352 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.objects.instance [None req-ac2221a8-f973-401a-bfde-54f8b82435e2 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lazy-loading 'services' on Instance uuid 12510adf-5d89-4a7a-ac07-b5ff07f99092 {{(pid=124333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:44:04.918159 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-ac2221a8-f973-401a-bfde-54f8b82435e2 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "DELETE /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092/os-volume_attachments/1bde4f09-fe5c-4b34-a069-1b4f4675bcc1" status: 202 len: 0 microversion: 2.1 time: 0.190131 Jul 31 18:44:04.918728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 372/763] 10.222.0.49 () {58 vars in 1416 bytes} [Sun Jul 31 18:44:04 2022] DELETE /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092/os-volume_attachments/1bde4f09-fe5c-4b34-a069-1b4f4675bcc1 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:44:05.174928 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f4d235ac-eed2-4ce1-a84c-8d905dcdd01b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:05.175480 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-f4d235ac-eed2-4ce1-a84c-8d905dcdd01b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:05.182528 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f4d235ac-eed2-4ce1-a84c-8d905dcdd01b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:05.183255 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f4d235ac-eed2-4ce1-a84c-8d905dcdd01b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:05.184561 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f4d235ac-eed2-4ce1-a84c-8d905dcdd01b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:05.185243 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f4d235ac-eed2-4ce1-a84c-8d905dcdd01b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:05.327517 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-f4d235ac-eed2-4ce1-a84c-8d905dcdd01b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:05.338125 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-f4d235ac-eed2-4ce1-a84c-8d905dcdd01b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:05.340123 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-f4d235ac-eed2-4ce1-a84c-8d905dcdd01b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:05.341336 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-f4d235ac-eed2-4ce1-a84c-8d905dcdd01b tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1722 microversion: 2.20 time: 0.170475 Jul 31 18:44:05.341888 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 392/764] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:44:05 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:44:06.368744 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-3566997b-5093-461f-ac2b-4bc26097bccd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:06.369589 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-3566997b-5093-461f-ac2b-4bc26097bccd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:06.378318 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3566997b-5093-461f-ac2b-4bc26097bccd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:06.378851 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3566997b-5093-461f-ac2b-4bc26097bccd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:06.379752 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3566997b-5093-461f-ac2b-4bc26097bccd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:06.380278 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3566997b-5093-461f-ac2b-4bc26097bccd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:06.517385 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-3566997b-5093-461f-ac2b-4bc26097bccd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:06.525566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-3566997b-5093-461f-ac2b-4bc26097bccd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:06.527182 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-3566997b-5093-461f-ac2b-4bc26097bccd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:06.528340 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-3566997b-5093-461f-ac2b-4bc26097bccd tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1722 microversion: 2.20 time: 0.166334 Jul 31 18:44:06.528956 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 373/765] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:44:06 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:44:07.551359 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-3b9dc003-3a35-4726-be7b-f4009eabd88f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:07.552666 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-3b9dc003-3a35-4726-be7b-f4009eabd88f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:07.563903 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3b9dc003-3a35-4726-be7b-f4009eabd88f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:07.564183 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3b9dc003-3a35-4726-be7b-f4009eabd88f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:07.564988 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3b9dc003-3a35-4726-be7b-f4009eabd88f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:07.565394 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3b9dc003-3a35-4726-be7b-f4009eabd88f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:07.705729 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-3b9dc003-3a35-4726-be7b-f4009eabd88f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:07.715359 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-3b9dc003-3a35-4726-be7b-f4009eabd88f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:07.716874 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-3b9dc003-3a35-4726-be7b-f4009eabd88f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:07.718087 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-3b9dc003-3a35-4726-be7b-f4009eabd88f tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1722 microversion: 2.20 time: 0.170613 Jul 31 18:44:07.718636 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 393/766] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:44:07 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:44:08.234677 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-b8ac29d5-1526-48c0-975d-7f09ffe30499 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:08.235257 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-b8ac29d5-1526-48c0-975d-7f09ffe30499 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: 12510adf-5d89-4a7a-ac07-b5ff07f99092] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:08.243055 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b8ac29d5-1526-48c0-975d-7f09ffe30499 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:08.243524 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b8ac29d5-1526-48c0-975d-7f09ffe30499 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:08.244433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b8ac29d5-1526-48c0-975d-7f09ffe30499 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:08.244926 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b8ac29d5-1526-48c0-975d-7f09ffe30499 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:08.278019 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-b8ac29d5-1526-48c0-975d-7f09ffe30499 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: 12510adf-5d89-4a7a-ac07-b5ff07f99092] Going to try to terminate instance {{(pid=124333) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 18:44:08.385973 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-b8ac29d5-1526-48c0-975d-7f09ffe30499 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "DELETE /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092" status: 204 len: 0 microversion: 2.1 time: 0.174014 Jul 31 18:44:08.391574 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 374/767] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:44:08 2022] DELETE /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 18:44:08.399234 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-15acbfd1-a7a4-4e0c-9641-0c6145bc861a tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:08.399363 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-15acbfd1-a7a4-4e0c-9641-0c6145bc861a tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: 12510adf-5d89-4a7a-ac07-b5ff07f99092] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:08.409028 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-15acbfd1-a7a4-4e0c-9641-0c6145bc861a tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:08.410615 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-15acbfd1-a7a4-4e0c-9641-0c6145bc861a tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:08.413868 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-15acbfd1-a7a4-4e0c-9641-0c6145bc861a tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:08.415434 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-15acbfd1-a7a4-4e0c-9641-0c6145bc861a tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:08.571234 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-15acbfd1-a7a4-4e0c-9641-0c6145bc861a tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:08.580098 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-15acbfd1-a7a4-4e0c-9641-0c6145bc861a tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092" status: 200 len: 1514 microversion: 2.1 time: 0.187229 Jul 31 18:44:08.580673 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 394/768] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:44:08 2022] GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092 => generated 1514 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:44:08.683689 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-489136b2-071c-4ef4-909e-8ec86905a59c req-3f27bd53-6f89-4432-aa91-b909ce43bd27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1da82e-1477-4392-a5db-0113b56cf487", "name": "network-vif-deleted", "tag": "c4842848-d109-451e-bfa5-d8934595abaf"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:44:08.693248 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-489136b2-071c-4ef4-909e-8ec86905a59c req-3f27bd53-6f89-4432-aa91-b909ce43bd27 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:08.693710 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-489136b2-071c-4ef4-909e-8ec86905a59c req-3f27bd53-6f89-4432-aa91-b909ce43bd27 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:08.705541 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-489136b2-071c-4ef4-909e-8ec86905a59c req-3f27bd53-6f89-4432-aa91-b909ce43bd27 service nova] Creating event network-vif-deleted:c4842848-d109-451e-bfa5-d8934595abaf for instance 8c1da82e-1477-4392-a5db-0113b56cf487 on hv-cinder-84984 Jul 31 18:44:08.710731 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-489136b2-071c-4ef4-909e-8ec86905a59c req-3f27bd53-6f89-4432-aa91-b909ce43bd27 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030981 Jul 31 18:44:08.711348 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 375/769] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:44:08.741665 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f16e0ee5-29f6-4b4c-b1ca-5db9bb808c2d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:08.742371 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-f16e0ee5-29f6-4b4c-b1ca-5db9bb808c2d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:08.749318 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f16e0ee5-29f6-4b4c-b1ca-5db9bb808c2d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:08.749757 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f16e0ee5-29f6-4b4c-b1ca-5db9bb808c2d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:08.750565 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f16e0ee5-29f6-4b4c-b1ca-5db9bb808c2d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:08.751175 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f16e0ee5-29f6-4b4c-b1ca-5db9bb808c2d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:08.816566 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-f16e0ee5-29f6-4b4c-b1ca-5db9bb808c2d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:08.825316 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-f16e0ee5-29f6-4b4c-b1ca-5db9bb808c2d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:08.826827 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-f16e0ee5-29f6-4b4c-b1ca-5db9bb808c2d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:08.828016 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-f16e0ee5-29f6-4b4c-b1ca-5db9bb808c2d tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1655 microversion: 2.20 time: 0.090742 Jul 31 18:44:08.828570 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 395/770] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:44:08 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1655 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 18:44:09.604307 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-0fdff741-f494-4a11-b1c9-df92b5456fb1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:09.605103 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-0fdff741-f494-4a11-b1c9-df92b5456fb1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: 12510adf-5d89-4a7a-ac07-b5ff07f99092] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:09.617875 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0fdff741-f494-4a11-b1c9-df92b5456fb1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:09.618672 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0fdff741-f494-4a11-b1c9-df92b5456fb1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:09.619630 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0fdff741-f494-4a11-b1c9-df92b5456fb1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:09.620092 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-0fdff741-f494-4a11-b1c9-df92b5456fb1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:09.780341 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-0fdff741-f494-4a11-b1c9-df92b5456fb1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:09.789772 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-0fdff741-f494-4a11-b1c9-df92b5456fb1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092" status: 200 len: 1514 microversion: 2.1 time: 0.191416 Jul 31 18:44:09.790348 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 376/771] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:44:09 2022] GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092 => generated 1514 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:44:09.851748 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-29b7a03b-d426-49a4-baaa-fa3dd87cf4d5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:09.852366 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-29b7a03b-d426-49a4-baaa-fa3dd87cf4d5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:09.859143 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-29b7a03b-d426-49a4-baaa-fa3dd87cf4d5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:09.859588 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-29b7a03b-d426-49a4-baaa-fa3dd87cf4d5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:09.860358 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-29b7a03b-d426-49a4-baaa-fa3dd87cf4d5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:09.860786 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-29b7a03b-d426-49a4-baaa-fa3dd87cf4d5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:09.892218 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-29b7a03b-d426-49a4-baaa-fa3dd87cf4d5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:09.892659 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-29b7a03b-d426-49a4-baaa-fa3dd87cf4d5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:09.893219 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.objects.instance [None req-29b7a03b-d426-49a4-baaa-fa3dd87cf4d5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lazy-loading 'fault' on Instance uuid 8c1da82e-1477-4392-a5db-0113b56cf487 {{(pid=124334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:44:09.934444 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-29b7a03b-d426-49a4-baaa-fa3dd87cf4d5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:09.942606 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-29b7a03b-d426-49a4-baaa-fa3dd87cf4d5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:09.944035 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-29b7a03b-d426-49a4-baaa-fa3dd87cf4d5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '120c06d6dee6425ea5366b363d5a5f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2269cace554c401a8b6a6303ff4e4da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:09.945290 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-29b7a03b-d426-49a4-baaa-fa3dd87cf4d5 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 200 len: 1370 microversion: 2.20 time: 0.097575 Jul 31 18:44:09.945840 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 396/772] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:44:09 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 1370 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 18:44:10.726411 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-33107a78-c8a5-4a0e-9979-e85b78472994 req-6290849f-7146-4d22-a407-2870fd8fbac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12510adf-5d89-4a7a-ac07-b5ff07f99092", "name": "network-vif-deleted", "tag": "524ea4aa-10b2-46f4-b7f8-682379bb10a8"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:44:10.737339 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-33107a78-c8a5-4a0e-9979-e85b78472994 req-6290849f-7146-4d22-a407-2870fd8fbac9 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:10.737981 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-33107a78-c8a5-4a0e-9979-e85b78472994 req-6290849f-7146-4d22-a407-2870fd8fbac9 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:10.750913 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-33107a78-c8a5-4a0e-9979-e85b78472994 req-6290849f-7146-4d22-a407-2870fd8fbac9 service nova] Creating event network-vif-deleted:524ea4aa-10b2-46f4-b7f8-682379bb10a8 for instance 12510adf-5d89-4a7a-ac07-b5ff07f99092 on hv-cinder-84984 Jul 31 18:44:10.756620 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-33107a78-c8a5-4a0e-9979-e85b78472994 req-6290849f-7146-4d22-a407-2870fd8fbac9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034585 Jul 31 18:44:10.757295 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 377/773] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:44:10.811800 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-c404c452-adbd-4b07-b5b1-e752dbf0ca00 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:10.812420 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-c404c452-adbd-4b07-b5b1-e752dbf0ca00 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: 12510adf-5d89-4a7a-ac07-b5ff07f99092] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:10.818420 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c404c452-adbd-4b07-b5b1-e752dbf0ca00 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:10.818869 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c404c452-adbd-4b07-b5b1-e752dbf0ca00 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:10.819630 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c404c452-adbd-4b07-b5b1-e752dbf0ca00 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:10.820104 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c404c452-adbd-4b07-b5b1-e752dbf0ca00 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:10.850618 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c404c452-adbd-4b07-b5b1-e752dbf0ca00 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:10.851032 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c404c452-adbd-4b07-b5b1-e752dbf0ca00 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:10.851473 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.objects.instance [None req-c404c452-adbd-4b07-b5b1-e752dbf0ca00 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lazy-loading 'fault' on Instance uuid 12510adf-5d89-4a7a-ac07-b5ff07f99092 {{(pid=124334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:44:10.892372 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-c404c452-adbd-4b07-b5b1-e752dbf0ca00 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:10.902303 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-c404c452-adbd-4b07-b5b1-e752dbf0ca00 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092" status: 200 len: 1309 microversion: 2.1 time: 0.093604 Jul 31 18:44:10.916695 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 397/774] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:44:10 2022] GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092 => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:44:10.969572 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-a442390a-6729-4232-857f-142dbf2ca352 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:10.970183 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-a442390a-6729-4232-857f-142dbf2ca352 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:10.976393 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a442390a-6729-4232-857f-142dbf2ca352 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:10.976861 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a442390a-6729-4232-857f-142dbf2ca352 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:10.977610 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a442390a-6729-4232-857f-142dbf2ca352 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:10.978033 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-a442390a-6729-4232-857f-142dbf2ca352 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:10.990871 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-a442390a-6729-4232-857f-142dbf2ca352 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] HTTP exception thrown: Instance 8c1da82e-1477-4392-a5db-0113b56cf487 could not be found. Jul 31 18:44:10.992598 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-a442390a-6729-4232-857f-142dbf2ca352 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Request method failure captured: Jul 31 18:44:10.992598 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 HTTP/1.1 Jul 31 18:44:10.992598 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:44:10.992598 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:44:10.992598 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:44:10.992598 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:44:10.992598 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:44:10.992598 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:44:10.992598 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:44:10.992598 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:44:10.992598 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5svjSuR5N4dB2eCKwtgsXgLl_WFPhajDm9bsR4kFoBsxpn-r1C3B1szd5mu0y_e7hPNdp_RaLMfKilXJF-PbPnquuFcGMXnes1A2ED6kR-3qePmosPOtip_2OVenbVDeD1iebRbb5cF91SybT8fp7wdFop6zP5MVSYqGCQNjmLkvyzs Jul 31 18:44:10.992598 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:44:10.992598 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:44:10.992598 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:44:10.992598 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:44:10.992598 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Openstack-Nova-Api-Version: 2.20 Jul 31 18:44:10.992598 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:44:10.992598 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:44:10.992598 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: 2269cace554c401a8b6a6303ff4e4da8 Jul 31 18:44:10.992598 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1727691475 Jul 31 18:44:10.992598 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:44:10.992598 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:44:10.994156 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2269cace554c401a8b6a6303ff4e4da8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2269cace554c401a8b6a6303ff4e4da8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2269cace554c401a8b6a6303ff4e4da8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2269cace554c401a8b6a6303ff4e4da8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:44:10.994156 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1727691475 Jul 31 18:44:10.994156 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: 2269cace554c401a8b6a6303ff4e4da8 Jul 31 18:44:10.994156 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1727691475 Jul 31 18:44:10.994156 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-AttachVolumeShelveTestJSON-1727691475-project Jul 31 18:44:10.994156 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:44:10.994156 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:44:10.994156 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 120c06d6dee6425ea5366b363d5a5f7e Jul 31 18:44:10.994156 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1727691475-project Jul 31 18:44:10.994156 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: > Jul 31 18:44:10.994156 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Instance 8c1da82e-1477-4392-a5db-0113b56cf487 could not be found. Jul 31 18:44:10.994156 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': '8c1da82e-1477-4392-a5db-0113b56cf487'} Jul 31 18:44:10.995059 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:44:10.995059 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:44:10.995059 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:44:10.995059 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:44:10.995059 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:44:10.995059 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:44:10.995059 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:44:10.995059 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:44:10.995059 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:44:10.995059 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:44:10.995059 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c1da82e-1477-4392-a5db-0113b56cf487 could not be found. Jul 31 18:44:10.995059 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:44:10.995059 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:44:10.995059 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:44:10.995059 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:44:10.995059 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:44:10.995059 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:44:10.995059 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:44:10.995059 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:44:10.995059 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:44:10.996405 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:44:10.996405 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:44:10.996405 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:44:10.996405 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:44:10.996405 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:44:10.996405 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:44:10.996405 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:44:10.996405 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c1da82e-1477-4392-a5db-0113b56cf487 could not be found. Jul 31 18:44:10.996405 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:44:10.996405 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:44:10.996405 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:44:10.996405 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:44:10.996405 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:44:10.996405 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:44:10.996405 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:44:10.996405 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:44:10.996405 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c1da82e-1477-4392-a5db-0113b56cf487 could not be found. Jul 31 18:44:10.996405 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:44:10.997635 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-a442390a-6729-4232-857f-142dbf2ca352 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Returning 404 to user: Instance 8c1da82e-1477-4392-a5db-0113b56cf487 could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:44:10.997635 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-a442390a-6729-4232-857f-142dbf2ca352 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 404 len: 111 microversion: 2.20 time: 0.028824 Jul 31 18:44:10.997635 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 378/775] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:44:10 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 18:44:11.003624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-2307ea35-439d-4e4b-8568-46b02589d70a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '.version_select at 0x7f870998bdc0>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:11.024016 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-2307ea35-439d-4e4b-8568-46b02589d70a tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-854467955" status: 204 len: 0 microversion: 2.20 time: 0.024675 Jul 31 18:44:11.024594 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 398/776] 10.222.0.49 () {60 vars in 1259 bytes} [Sun Jul 31 18:44:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-854467955 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 18:44:11.923481 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-3a882fa0-2116-4ce7-9e9c-e5e8f12ed43f tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:11.924636 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-3a882fa0-2116-4ce7-9e9c-e5e8f12ed43f tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: 12510adf-5d89-4a7a-ac07-b5ff07f99092] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:11.931816 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3a882fa0-2116-4ce7-9e9c-e5e8f12ed43f tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:11.932436 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3a882fa0-2116-4ce7-9e9c-e5e8f12ed43f tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:11.933432 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3a882fa0-2116-4ce7-9e9c-e5e8f12ed43f tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:11.934001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3a882fa0-2116-4ce7-9e9c-e5e8f12ed43f tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:11.949856 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-3a882fa0-2116-4ce7-9e9c-e5e8f12ed43f tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] HTTP exception thrown: Instance 12510adf-5d89-4a7a-ac07-b5ff07f99092 could not be found. Jul 31 18:44:11.951703 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-3a882fa0-2116-4ce7-9e9c-e5e8f12ed43f tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Request method failure captured: Jul 31 18:44:11.951703 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092 HTTP/1.1 Jul 31 18:44:11.951703 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:44:11.951703 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:44:11.951703 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:44:11.951703 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:44:11.951703 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:44:11.951703 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:44:11.951703 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:44:11.951703 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:44:11.951703 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5s06uxot3oQZfPN59024hg7hBMQc79gbzIVslNHIfAEqyhe-Co-wrtAIMGi5P8url8eFmdvwTA-sc5HxdwAhBgmW3_lbRrC55tCg9wwcI4yxxHwIZTkxhXbdEszLVbmFpkw_UG853uvVZEfMaZ5wsDUCcxXZ-yrf0XZvCmId9O1OUF0 Jul 31 18:44:11.951703 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:44:11.951703 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:44:11.951703 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:44:11.951703 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:44:11.951703 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:44:11.951703 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:44:11.951703 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: 9540ab0260cc4c0ca76036b79bb5f506 Jul 31 18:44:11.951703 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-VolumesSnapshotTestJSON-805065598 Jul 31 18:44:11.951703 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:44:11.951703 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:44:11.953381 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9540ab0260cc4c0ca76036b79bb5f506"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9540ab0260cc4c0ca76036b79bb5f506", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9540ab0260cc4c0ca76036b79bb5f506"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9540ab0260cc4c0ca76036b79bb5f506"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:44:11.953381 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-VolumesSnapshotTestJSON-805065598 Jul 31 18:44:11.953381 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: 9540ab0260cc4c0ca76036b79bb5f506 Jul 31 18:44:11.953381 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-805065598 Jul 31 18:44:11.953381 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-VolumesSnapshotTestJSON-805065598-project Jul 31 18:44:11.953381 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:44:11.953381 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:44:11.953381 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: f5d3517f51b74230964f1e2b29371e0b Jul 31 18:44:11.953381 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-VolumesSnapshotTestJSON-805065598-project Jul 31 18:44:11.953381 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: > Jul 31 18:44:11.953381 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Instance 12510adf-5d89-4a7a-ac07-b5ff07f99092 could not be found. Jul 31 18:44:11.953381 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': '12510adf-5d89-4a7a-ac07-b5ff07f99092'} Jul 31 18:44:11.954327 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:44:11.954327 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:44:11.954327 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:44:11.954327 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:44:11.954327 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:44:11.954327 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:44:11.954327 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:44:11.954327 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:44:11.954327 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:44:11.954327 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:44:11.954327 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12510adf-5d89-4a7a-ac07-b5ff07f99092 could not be found. Jul 31 18:44:11.954327 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:44:11.954327 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:44:11.954327 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:44:11.954327 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:44:11.954327 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:44:11.954327 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:44:11.954327 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:44:11.954327 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:44:11.954327 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:44:11.955596 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:44:11.955596 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:44:11.955596 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:44:11.955596 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:44:11.955596 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:44:11.955596 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:44:11.955596 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:44:11.955596 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12510adf-5d89-4a7a-ac07-b5ff07f99092 could not be found. Jul 31 18:44:11.955596 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:44:11.955596 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:44:11.955596 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:44:11.955596 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:44:11.955596 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:44:11.955596 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:44:11.955596 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:44:11.955596 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:44:11.955596 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12510adf-5d89-4a7a-ac07-b5ff07f99092 could not be found. Jul 31 18:44:11.955596 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:44:11.958805 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-3a882fa0-2116-4ce7-9e9c-e5e8f12ed43f tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Returning 404 to user: Instance 12510adf-5d89-4a7a-ac07-b5ff07f99092 could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:44:11.960166 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-3a882fa0-2116-4ce7-9e9c-e5e8f12ed43f tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092" status: 404 len: 111 microversion: 2.1 time: 0.040536 Jul 31 18:44:11.961384 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 379/777] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:44:11 2022] GET /compute/v2.1/servers/12510adf-5d89-4a7a-ac07-b5ff07f99092 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:44:12.828042 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-a7d057f4-40e9-43d2-a571-8a1ded8af02c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:12.828581 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-a7d057f4-40e9-43d2-a571-8a1ded8af02c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:12.834727 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a7d057f4-40e9-43d2-a571-8a1ded8af02c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:12.835178 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a7d057f4-40e9-43d2-a571-8a1ded8af02c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:12.835976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a7d057f4-40e9-43d2-a571-8a1ded8af02c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:12.836411 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a7d057f4-40e9-43d2-a571-8a1ded8af02c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:12.850098 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-a7d057f4-40e9-43d2-a571-8a1ded8af02c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] HTTP exception thrown: Instance 8c1da82e-1477-4392-a5db-0113b56cf487 could not be found. Jul 31 18:44:12.851775 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-a7d057f4-40e9-43d2-a571-8a1ded8af02c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Request method failure captured: Jul 31 18:44:12.851775 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: DELETE /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 HTTP/1.1 Jul 31 18:44:12.851775 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:44:12.851775 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:44:12.851775 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:44:12.851775 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 0 Jul 31 18:44:12.851775 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:44:12.851775 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:44:12.851775 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:44:12.851775 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:44:12.851775 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5svjSuR5N4dB2eCKwtgsXgLl_WFPhajDm9bsR4kFoBsxpn-r1C3B1szd5mu0y_e7hPNdp_RaLMfKilXJF-PbPnquuFcGMXnes1A2ED6kR-3qePmosPOtip_2OVenbVDeD1iebRbb5cF91SybT8fp7wdFop6zP5MVSYqGCQNjmLkvyzs Jul 31 18:44:12.851775 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:44:12.851775 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:44:12.851775 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:44:12.851775 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:44:12.851775 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Openstack-Nova-Api-Version: 2.20 Jul 31 18:44:12.851775 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:44:12.851775 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:44:12.851775 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: 2269cace554c401a8b6a6303ff4e4da8 Jul 31 18:44:12.851775 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1727691475 Jul 31 18:44:12.851775 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:44:12.851775 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:44:12.853270 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2269cace554c401a8b6a6303ff4e4da8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2269cace554c401a8b6a6303ff4e4da8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2269cace554c401a8b6a6303ff4e4da8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2269cace554c401a8b6a6303ff4e4da8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:44:12.853270 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1727691475 Jul 31 18:44:12.853270 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: 2269cace554c401a8b6a6303ff4e4da8 Jul 31 18:44:12.853270 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1727691475 Jul 31 18:44:12.853270 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-AttachVolumeShelveTestJSON-1727691475-project Jul 31 18:44:12.853270 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:44:12.853270 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:44:12.853270 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: 120c06d6dee6425ea5366b363d5a5f7e Jul 31 18:44:12.853270 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1727691475-project Jul 31 18:44:12.853270 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: > Jul 31 18:44:12.853270 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Instance 8c1da82e-1477-4392-a5db-0113b56cf487 could not be found. Jul 31 18:44:12.853270 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'id': '8c1da82e-1477-4392-a5db-0113b56cf487'} Jul 31 18:44:12.854192 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:44:12.854192 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:44:12.854192 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:44:12.854192 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:44:12.854192 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:44:12.854192 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:44:12.854192 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:44:12.854192 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:44:12.854192 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:44:12.854192 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:44:12.854192 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c1da82e-1477-4392-a5db-0113b56cf487 could not be found. Jul 31 18:44:12.854192 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:44:12.854192 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:44:12.854192 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:44:12.854192 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:44:12.854192 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:44:12.854192 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:44:12.854192 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:44:12.854192 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:44:12.854192 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:44:12.855662 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:44:12.855662 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 18:44:12.855662 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 18:44:12.855662 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 18:44:12.855662 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 18:44:12.855662 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:44:12.855662 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:44:12.855662 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:44:12.855662 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:44:12.855662 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c1da82e-1477-4392-a5db-0113b56cf487 could not be found. Jul 31 18:44:12.855662 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:44:12.855662 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:44:12.855662 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:44:12.855662 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:44:12.855662 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:44:12.855662 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:44:12.855662 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:44:12.855662 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:44:12.855662 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c1da82e-1477-4392-a5db-0113b56cf487 could not be found. Jul 31 18:44:12.855662 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:44:12.857511 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-a7d057f4-40e9-43d2-a571-8a1ded8af02c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Returning 404 to user: Instance 8c1da82e-1477-4392-a5db-0113b56cf487 could not be found. {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:44:12.857511 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-a7d057f4-40e9-43d2-a571-8a1ded8af02c tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 404 len: 111 microversion: 2.20 time: 0.029812 Jul 31 18:44:12.857511 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 399/778] 10.222.0.49 () {60 vars in 1280 bytes} [Sun Jul 31 18:44:12 2022] DELETE /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 18:44:12.861759 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-ad0a7d13-ef7c-4aa8-9766-9eb8f9d091ce tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:12.862368 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-ad0a7d13-ef7c-4aa8-9766-9eb8f9d091ce tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 8c1da82e-1477-4392-a5db-0113b56cf487] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:12.868637 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ad0a7d13-ef7c-4aa8-9766-9eb8f9d091ce tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:12.869119 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ad0a7d13-ef7c-4aa8-9766-9eb8f9d091ce tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:12.869878 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ad0a7d13-ef7c-4aa8-9766-9eb8f9d091ce tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:12.870312 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ad0a7d13-ef7c-4aa8-9766-9eb8f9d091ce tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:12.884316 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-ad0a7d13-ef7c-4aa8-9766-9eb8f9d091ce tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] HTTP exception thrown: Instance 8c1da82e-1477-4392-a5db-0113b56cf487 could not be found. Jul 31 18:44:12.885858 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-ad0a7d13-ef7c-4aa8-9766-9eb8f9d091ce tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Request method failure captured: Jul 31 18:44:12.885858 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 HTTP/1.1 Jul 31 18:44:12.885858 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:44:12.885858 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:44:12.885858 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:44:12.885858 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:44:12.885858 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:44:12.885858 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:44:12.885858 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:44:12.885858 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:44:12.885858 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5svjSuR5N4dB2eCKwtgsXgLl_WFPhajDm9bsR4kFoBsxpn-r1C3B1szd5mu0y_e7hPNdp_RaLMfKilXJF-PbPnquuFcGMXnes1A2ED6kR-3qePmosPOtip_2OVenbVDeD1iebRbb5cF91SybT8fp7wdFop6zP5MVSYqGCQNjmLkvyzs Jul 31 18:44:12.885858 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:44:12.885858 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:44:12.885858 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:44:12.885858 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:44:12.885858 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Openstack-Nova-Api-Version: 2.20 Jul 31 18:44:12.885858 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:44:12.885858 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:44:12.885858 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: 2269cace554c401a8b6a6303ff4e4da8 Jul 31 18:44:12.885858 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1727691475 Jul 31 18:44:12.885858 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:44:12.885858 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:44:12.887469 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2269cace554c401a8b6a6303ff4e4da8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2269cace554c401a8b6a6303ff4e4da8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2269cace554c401a8b6a6303ff4e4da8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2269cace554c401a8b6a6303ff4e4da8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:44:12.887469 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1727691475 Jul 31 18:44:12.887469 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: 2269cace554c401a8b6a6303ff4e4da8 Jul 31 18:44:12.887469 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1727691475 Jul 31 18:44:12.887469 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-AttachVolumeShelveTestJSON-1727691475-project Jul 31 18:44:12.887469 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:44:12.887469 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:44:12.887469 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 120c06d6dee6425ea5366b363d5a5f7e Jul 31 18:44:12.887469 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1727691475-project Jul 31 18:44:12.887469 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: > Jul 31 18:44:12.887469 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Instance 8c1da82e-1477-4392-a5db-0113b56cf487 could not be found. Jul 31 18:44:12.887469 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': '8c1da82e-1477-4392-a5db-0113b56cf487'} Jul 31 18:44:12.888522 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:44:12.888522 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:44:12.888522 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:44:12.888522 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:44:12.888522 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:44:12.888522 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:44:12.888522 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:44:12.888522 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:44:12.888522 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:44:12.888522 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:44:12.888522 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c1da82e-1477-4392-a5db-0113b56cf487 could not be found. Jul 31 18:44:12.888522 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:44:12.888522 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:44:12.888522 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:44:12.888522 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:44:12.888522 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:44:12.888522 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:44:12.888522 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:44:12.888522 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:44:12.888522 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:44:12.890078 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:44:12.890078 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:44:12.890078 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:44:12.890078 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:44:12.890078 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:44:12.890078 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:44:12.890078 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:44:12.890078 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c1da82e-1477-4392-a5db-0113b56cf487 could not be found. Jul 31 18:44:12.890078 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:44:12.890078 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:44:12.890078 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:44:12.890078 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:44:12.890078 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:44:12.890078 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:44:12.890078 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:44:12.890078 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:44:12.890078 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c1da82e-1477-4392-a5db-0113b56cf487 could not be found. Jul 31 18:44:12.890078 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:44:12.892331 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-ad0a7d13-ef7c-4aa8-9766-9eb8f9d091ce tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Returning 404 to user: Instance 8c1da82e-1477-4392-a5db-0113b56cf487 could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:44:12.892331 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-ad0a7d13-ef7c-4aa8-9766-9eb8f9d091ce tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487" status: 404 len: 111 microversion: 2.20 time: 0.029357 Jul 31 18:44:12.892331 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 380/779] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:44:12 2022] GET /compute/v2.1/servers/8c1da82e-1477-4392-a5db-0113b56cf487 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 18:44:18.420998 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-1befa0df-0ef5-4f15-9390-bb0130356327 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:18.421680 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-1befa0df-0ef5-4f15-9390-bb0130356327 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:18.428404 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1befa0df-0ef5-4f15-9390-bb0130356327 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:18.428883 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1befa0df-0ef5-4f15-9390-bb0130356327 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:18.429672 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1befa0df-0ef5-4f15-9390-bb0130356327 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:18.430101 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1befa0df-0ef5-4f15-9390-bb0130356327 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:18.445943 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-1befa0df-0ef5-4f15-9390-bb0130356327 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] HTTP exception thrown: Instance 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f could not be found. Jul 31 18:44:18.447502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-1befa0df-0ef5-4f15-9390-bb0130356327 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Request method failure captured: Jul 31 18:44:18.447502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: DELETE /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f HTTP/1.1 Jul 31 18:44:18.447502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:44:18.447502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:44:18.447502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:44:18.447502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 0 Jul 31 18:44:18.447502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:44:18.447502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:44:18.447502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:44:18.447502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:44:18.447502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5svjSuR5N4dB2eCKwtgsXgLl_WFPhajDm9bsR4kFoBsxpn-r1C3B1szd5mu0y_e7hPNdp_RaLMfKilXJF-PbPnquuFcGMXnes1A2ED6kR-3qePmosPOtip_2OVenbVDeD1iebRbb5cF91SybT8fp7wdFop6zP5MVSYqGCQNjmLkvyzs Jul 31 18:44:18.447502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:44:18.447502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:44:18.447502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:44:18.447502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:44:18.447502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Openstack-Nova-Api-Version: 2.20 Jul 31 18:44:18.447502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:44:18.447502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:44:18.447502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: 2269cace554c401a8b6a6303ff4e4da8 Jul 31 18:44:18.447502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1727691475 Jul 31 18:44:18.447502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:44:18.447502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:44:18.450388 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2269cace554c401a8b6a6303ff4e4da8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2269cace554c401a8b6a6303ff4e4da8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2269cace554c401a8b6a6303ff4e4da8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2269cace554c401a8b6a6303ff4e4da8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:44:18.450388 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1727691475 Jul 31 18:44:18.450388 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: 2269cace554c401a8b6a6303ff4e4da8 Jul 31 18:44:18.450388 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1727691475 Jul 31 18:44:18.450388 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-AttachVolumeShelveTestJSON-1727691475-project Jul 31 18:44:18.450388 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:44:18.450388 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:44:18.450388 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: 120c06d6dee6425ea5366b363d5a5f7e Jul 31 18:44:18.450388 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1727691475-project Jul 31 18:44:18.450388 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: > Jul 31 18:44:18.450388 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Instance 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f could not be found. Jul 31 18:44:18.450388 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'id': '432e6c6a-9a11-4f18-8dbe-fbb82e95f39f'} Jul 31 18:44:18.452188 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:44:18.452188 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:44:18.452188 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:44:18.452188 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:44:18.452188 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:44:18.452188 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:44:18.452188 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:44:18.452188 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:44:18.452188 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:44:18.452188 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:44:18.452188 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f could not be found. Jul 31 18:44:18.452188 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:44:18.452188 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:44:18.452188 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:44:18.452188 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:44:18.452188 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:44:18.452188 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:44:18.452188 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:44:18.452188 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:44:18.452188 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:44:18.457460 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:44:18.457460 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 18:44:18.457460 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 18:44:18.457460 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 18:44:18.457460 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 18:44:18.457460 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:44:18.457460 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:44:18.457460 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:44:18.457460 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:44:18.457460 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f could not be found. Jul 31 18:44:18.457460 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:44:18.457460 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:44:18.457460 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:44:18.457460 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:44:18.457460 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:44:18.457460 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:44:18.457460 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:44:18.457460 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:44:18.457460 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f could not be found. Jul 31 18:44:18.457460 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:44:18.459056 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-1befa0df-0ef5-4f15-9390-bb0130356327 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Returning 404 to user: Instance 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f could not be found. {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:44:18.459056 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-1befa0df-0ef5-4f15-9390-bb0130356327 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "DELETE /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 404 len: 111 microversion: 2.20 time: 0.032849 Jul 31 18:44:18.459056 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 400/780] 10.222.0.49 () {60 vars in 1280 bytes} [Sun Jul 31 18:44:18 2022] DELETE /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 18:44:18.462324 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-c4165891-2552-4eff-bfc7-bf5c9cd733f2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:18.463448 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-c4165891-2552-4eff-bfc7-bf5c9cd733f2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] [instance: 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:18.473833 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c4165891-2552-4eff-bfc7-bf5c9cd733f2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:18.474625 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c4165891-2552-4eff-bfc7-bf5c9cd733f2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:18.475746 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c4165891-2552-4eff-bfc7-bf5c9cd733f2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:18.476471 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c4165891-2552-4eff-bfc7-bf5c9cd733f2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:18.497389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-c4165891-2552-4eff-bfc7-bf5c9cd733f2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] HTTP exception thrown: Instance 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f could not be found. Jul 31 18:44:18.497389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-c4165891-2552-4eff-bfc7-bf5c9cd733f2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Request method failure captured: Jul 31 18:44:18.497389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f HTTP/1.1 Jul 31 18:44:18.497389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:44:18.497389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:44:18.497389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:44:18.497389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:44:18.497389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:44:18.497389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:44:18.497389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:44:18.497389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:44:18.497389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5svjSuR5N4dB2eCKwtgsXgLl_WFPhajDm9bsR4kFoBsxpn-r1C3B1szd5mu0y_e7hPNdp_RaLMfKilXJF-PbPnquuFcGMXnes1A2ED6kR-3qePmosPOtip_2OVenbVDeD1iebRbb5cF91SybT8fp7wdFop6zP5MVSYqGCQNjmLkvyzs Jul 31 18:44:18.497389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:44:18.497389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:44:18.497389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:44:18.497389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:44:18.497389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Openstack-Nova-Api-Version: 2.20 Jul 31 18:44:18.497389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:44:18.497389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:44:18.497389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: 2269cace554c401a8b6a6303ff4e4da8 Jul 31 18:44:18.497389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1727691475 Jul 31 18:44:18.497389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:44:18.497389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:44:18.499138 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2269cace554c401a8b6a6303ff4e4da8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2269cace554c401a8b6a6303ff4e4da8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2269cace554c401a8b6a6303ff4e4da8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2269cace554c401a8b6a6303ff4e4da8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:44:18.499138 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1727691475 Jul 31 18:44:18.499138 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: 2269cace554c401a8b6a6303ff4e4da8 Jul 31 18:44:18.499138 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1727691475 Jul 31 18:44:18.499138 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-AttachVolumeShelveTestJSON-1727691475-project Jul 31 18:44:18.499138 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:44:18.499138 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:44:18.499138 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 120c06d6dee6425ea5366b363d5a5f7e Jul 31 18:44:18.499138 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1727691475-project Jul 31 18:44:18.499138 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: > Jul 31 18:44:18.499138 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Instance 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f could not be found. Jul 31 18:44:18.499138 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': '432e6c6a-9a11-4f18-8dbe-fbb82e95f39f'} Jul 31 18:44:18.500553 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:44:18.500553 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:44:18.500553 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:44:18.500553 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:44:18.500553 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:44:18.500553 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:44:18.500553 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:44:18.500553 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:44:18.500553 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:44:18.500553 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:44:18.500553 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f could not be found. Jul 31 18:44:18.500553 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:44:18.500553 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:44:18.500553 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:44:18.500553 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:44:18.500553 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:44:18.500553 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:44:18.500553 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:44:18.500553 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:44:18.500553 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:44:18.501900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:44:18.501900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:44:18.501900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:44:18.501900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:44:18.501900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:44:18.501900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:44:18.501900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:44:18.501900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f could not be found. Jul 31 18:44:18.501900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:44:18.501900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:44:18.501900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:44:18.501900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:44:18.501900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:44:18.501900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:44:18.501900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:44:18.501900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:44:18.501900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f could not be found. Jul 31 18:44:18.501900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:44:18.503534 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-c4165891-2552-4eff-bfc7-bf5c9cd733f2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] Returning 404 to user: Instance 432e6c6a-9a11-4f18-8dbe-fbb82e95f39f could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:44:18.503534 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-c4165891-2552-4eff-bfc7-bf5c9cd733f2 tempest-AttachVolumeShelveTestJSON-1727691475 tempest-AttachVolumeShelveTestJSON-1727691475-project] 10.222.0.49 "GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f" status: 404 len: 111 microversion: 2.20 time: 0.041574 Jul 31 18:44:18.503534 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 381/781] 10.222.0.49 () {60 vars in 1277 bytes} [Sun Jul 31 18:44:18 2022] GET /compute/v2.1/servers/432e6c6a-9a11-4f18-8dbe-fbb82e95f39f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 18:44:21.982165 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-af9dbe66-aa4e-481b-9a73-763f9768460d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2003844283", "imageRef": "6f2a0bb6-2fb3-4536-bee3-23e4e975f079", "flavorRef": "452", "networks": [{"uuid": "145afbfb-0dce-40b2-9a7d-dce1264ceef8"}]}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:44:22.061326 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.network.neutron [None req-af9dbe66-aa4e-481b-9a73-763f9768460d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] validate_networks() for [('145afbfb-0dce-40b2-9a7d-dce1264ceef8', None, None, None, None, None)] {{(pid=124334) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 18:44:22.717755 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-af9dbe66-aa4e-481b-9a73-763f9768460d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Flavor limits 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 18:44:22.718249 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-af9dbe66-aa4e-481b-9a73-763f9768460d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Image limits 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 18:44:22.718753 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-af9dbe66-aa4e-481b-9a73-763f9768460d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Flavor pref 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 18:44:22.719570 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-af9dbe66-aa4e-481b-9a73-763f9768460d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Image pref 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 18:44:22.719995 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-af9dbe66-aa4e-481b-9a73-763f9768460d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 18:44:22.733509 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-af9dbe66-aa4e-481b-9a73-763f9768460d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:22.734474 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-af9dbe66-aa4e-481b-9a73-763f9768460d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:22.735536 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-af9dbe66-aa4e-481b-9a73-763f9768460d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:22.736171 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-af9dbe66-aa4e-481b-9a73-763f9768460d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:22.756261 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.quota [None req-af9dbe66-aa4e-481b-9a73-763f9768460d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Getting quotas for project 9540ab0260cc4c0ca76036b79bb5f506. Resources: {'cores', 'ram', 'instances'} {{(pid=124334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:44:22.760575 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.quota [None req-af9dbe66-aa4e-481b-9a73-763f9768460d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Getting quotas for user f5d3517f51b74230964f1e2b29371e0b and project 9540ab0260cc4c0ca76036b79bb5f506. Resources: {'cores', 'ram', 'instances'} {{(pid=124334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:44:22.772252 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-af9dbe66-aa4e-481b-9a73-763f9768460d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Going to run 1 instances... {{(pid=124334) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 18:44:22.774570 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-af9dbe66-aa4e-481b-9a73-763f9768460d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: a9068580-2b7f-4645-9643-227c746fc56a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f2a0bb6-2fb3-4536-bee3-23e4e975f079',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 18:44:22.830303 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-af9dbe66-aa4e-481b-9a73-763f9768460d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.851453 Jul 31 18:44:22.831496 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 401/782] 10.222.0.49 () {60 vars in 1147 bytes} [Sun Jul 31 18:44:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 18:44:22.842783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-fe1294b9-f0b2-4b11-9407-09f037b2cb5b tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:22.844169 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-fe1294b9-f0b2-4b11-9407-09f037b2cb5b tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: a9068580-2b7f-4645-9643-227c746fc56a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:22.925069 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-fe1294b9-f0b2-4b11-9407-09f037b2cb5b tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:22.934098 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-fe1294b9-f0b2-4b11-9407-09f037b2cb5b tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a" status: 200 len: 1219 microversion: 2.1 time: 0.095654 Jul 31 18:44:22.947196 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 382/783] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:44:22 2022] GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:44:23.956926 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-459ec629-f106-4ab8-ac98-3c708353c1a5 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:23.957520 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-459ec629-f106-4ab8-ac98-3c708353c1a5 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: a9068580-2b7f-4645-9643-227c746fc56a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:23.967659 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-459ec629-f106-4ab8-ac98-3c708353c1a5 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:23.970193 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-459ec629-f106-4ab8-ac98-3c708353c1a5 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:23.973095 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-459ec629-f106-4ab8-ac98-3c708353c1a5 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:23.973796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-459ec629-f106-4ab8-ac98-3c708353c1a5 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:24.054678 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-459ec629-f106-4ab8-ac98-3c708353c1a5 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:24.062350 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-459ec629-f106-4ab8-ac98-3c708353c1a5 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a" status: 200 len: 1279 microversion: 2.1 time: 0.110661 Jul 31 18:44:24.064812 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 402/784] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:44:23 2022] GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a => generated 1279 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:44:25.088550 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-31b16d1c-eb7d-407d-b794-0c02ef7afa49 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:25.089292 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-31b16d1c-eb7d-407d-b794-0c02ef7afa49 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: a9068580-2b7f-4645-9643-227c746fc56a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:25.097773 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-31b16d1c-eb7d-407d-b794-0c02ef7afa49 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:25.098615 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-31b16d1c-eb7d-407d-b794-0c02ef7afa49 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:25.099436 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-31b16d1c-eb7d-407d-b794-0c02ef7afa49 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:25.100289 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-31b16d1c-eb7d-407d-b794-0c02ef7afa49 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:25.378240 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-31b16d1c-eb7d-407d-b794-0c02ef7afa49 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:25.393408 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-31b16d1c-eb7d-407d-b794-0c02ef7afa49 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a" status: 200 len: 1319 microversion: 2.1 time: 0.309503 Jul 31 18:44:25.394500 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 383/785] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:44:25 2022] GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a => generated 1319 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:44:25.594475 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-65fce993-5d5f-4624-922d-e1c75b8baaf4 req-ada61641-82f9-47f5-b498-e8202a493c7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9068580-2b7f-4645-9643-227c746fc56a", "tag": "3e173346-aa19-4fd0-8e9e-492bc2de5fdc"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:44:25.612396 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-65fce993-5d5f-4624-922d-e1c75b8baaf4 req-ada61641-82f9-47f5-b498-e8202a493c7c service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:25.613236 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-65fce993-5d5f-4624-922d-e1c75b8baaf4 req-ada61641-82f9-47f5-b498-e8202a493c7c service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:25.628746 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-65fce993-5d5f-4624-922d-e1c75b8baaf4 req-ada61641-82f9-47f5-b498-e8202a493c7c service nova] Creating event network-changed:3e173346-aa19-4fd0-8e9e-492bc2de5fdc for instance a9068580-2b7f-4645-9643-227c746fc56a on hv-cinder-84984 Jul 31 18:44:25.634927 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-65fce993-5d5f-4624-922d-e1c75b8baaf4 req-ada61641-82f9-47f5-b498-e8202a493c7c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045205 Jul 31 18:44:25.636087 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 403/786] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:44:26.415440 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-ff5be04f-fc56-4989-9d50-2754b4dde257 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:26.416131 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-ff5be04f-fc56-4989-9d50-2754b4dde257 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: a9068580-2b7f-4645-9643-227c746fc56a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:26.425347 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ff5be04f-fc56-4989-9d50-2754b4dde257 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:26.426868 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ff5be04f-fc56-4989-9d50-2754b4dde257 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:26.428355 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ff5be04f-fc56-4989-9d50-2754b4dde257 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:26.428995 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ff5be04f-fc56-4989-9d50-2754b4dde257 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:26.587616 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-ff5be04f-fc56-4989-9d50-2754b4dde257 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:26.597054 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-ff5be04f-fc56-4989-9d50-2754b4dde257 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a" status: 200 len: 1319 microversion: 2.1 time: 0.185928 Jul 31 18:44:26.607427 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 384/787] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:44:26 2022] GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:44:27.621651 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-72c140f3-1ad4-4bf2-a5d8-f9f6d900987c tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:27.622452 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-72c140f3-1ad4-4bf2-a5d8-f9f6d900987c tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: a9068580-2b7f-4645-9643-227c746fc56a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:27.630519 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-72c140f3-1ad4-4bf2-a5d8-f9f6d900987c tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:27.631618 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-72c140f3-1ad4-4bf2-a5d8-f9f6d900987c tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:27.632400 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-72c140f3-1ad4-4bf2-a5d8-f9f6d900987c tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:27.632864 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-72c140f3-1ad4-4bf2-a5d8-f9f6d900987c tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:27.796808 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-72c140f3-1ad4-4bf2-a5d8-f9f6d900987c tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:27.805404 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-72c140f3-1ad4-4bf2-a5d8-f9f6d900987c tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a" status: 200 len: 1319 microversion: 2.1 time: 0.189293 Jul 31 18:44:27.805993 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 404/788] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:44:27 2022] GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:44:28.826881 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-9eb2982b-124e-44b6-b220-62f4bc361ec1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:28.828110 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-9eb2982b-124e-44b6-b220-62f4bc361ec1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: a9068580-2b7f-4645-9643-227c746fc56a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:28.835217 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9eb2982b-124e-44b6-b220-62f4bc361ec1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:28.836019 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9eb2982b-124e-44b6-b220-62f4bc361ec1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:28.837280 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9eb2982b-124e-44b6-b220-62f4bc361ec1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:28.837792 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9eb2982b-124e-44b6-b220-62f4bc361ec1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:28.992190 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-9eb2982b-124e-44b6-b220-62f4bc361ec1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:28.999669 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-9eb2982b-124e-44b6-b220-62f4bc361ec1 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a" status: 200 len: 1319 microversion: 2.1 time: 0.176862 Jul 31 18:44:29.000216 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 385/789] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:44:28 2022] GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:44:30.021059 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-ed560ec1-7d5f-4b1a-98fd-cebaa7635008 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:30.021744 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-ed560ec1-7d5f-4b1a-98fd-cebaa7635008 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: a9068580-2b7f-4645-9643-227c746fc56a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:30.029240 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ed560ec1-7d5f-4b1a-98fd-cebaa7635008 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:30.029738 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ed560ec1-7d5f-4b1a-98fd-cebaa7635008 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:30.030802 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ed560ec1-7d5f-4b1a-98fd-cebaa7635008 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:30.031392 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ed560ec1-7d5f-4b1a-98fd-cebaa7635008 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:30.171016 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-ed560ec1-7d5f-4b1a-98fd-cebaa7635008 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:30.178801 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-ed560ec1-7d5f-4b1a-98fd-cebaa7635008 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a" status: 200 len: 1319 microversion: 2.1 time: 0.161721 Jul 31 18:44:30.179576 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 405/790] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:44:30 2022] GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:44:30.782437 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-1f4534f2-cce2-40ae-a2d0-747119871354 req-38f50ace-b933-4050-b01b-e717be4d68d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9068580-2b7f-4645-9643-227c746fc56a", "name": "network-vif-plugged", "status": "completed", "tag": "3e173346-aa19-4fd0-8e9e-492bc2de5fdc"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:44:30.793871 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-1f4534f2-cce2-40ae-a2d0-747119871354 req-38f50ace-b933-4050-b01b-e717be4d68d5 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:30.794588 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-1f4534f2-cce2-40ae-a2d0-747119871354 req-38f50ace-b933-4050-b01b-e717be4d68d5 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:30.819144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-1f4534f2-cce2-40ae-a2d0-747119871354 req-38f50ace-b933-4050-b01b-e717be4d68d5 service nova] Creating event network-vif-plugged:3e173346-aa19-4fd0-8e9e-492bc2de5fdc for instance a9068580-2b7f-4645-9643-227c746fc56a on hv-cinder-84984 Jul 31 18:44:30.824670 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-1f4534f2-cce2-40ae-a2d0-747119871354 req-38f50ace-b933-4050-b01b-e717be4d68d5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046542 Jul 31 18:44:30.825292 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 386/791] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:44:31.199635 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-1507d40f-621d-4d22-9f5f-b55e50362eaa tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:31.200325 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-1507d40f-621d-4d22-9f5f-b55e50362eaa tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: a9068580-2b7f-4645-9643-227c746fc56a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:31.206745 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1507d40f-621d-4d22-9f5f-b55e50362eaa tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:31.207398 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1507d40f-621d-4d22-9f5f-b55e50362eaa tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:31.208365 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1507d40f-621d-4d22-9f5f-b55e50362eaa tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:31.208995 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1507d40f-621d-4d22-9f5f-b55e50362eaa tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:31.366462 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-1507d40f-621d-4d22-9f5f-b55e50362eaa tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:31.375498 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-1507d40f-621d-4d22-9f5f-b55e50362eaa tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a" status: 200 len: 1319 microversion: 2.1 time: 0.179979 Jul 31 18:44:31.376068 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 406/792] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:44:31 2022] GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:44:32.399853 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-8107fb45-1e0d-449b-990c-f610a3729135 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:32.401961 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-8107fb45-1e0d-449b-990c-f610a3729135 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: a9068580-2b7f-4645-9643-227c746fc56a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:32.405063 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:32.411933 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8107fb45-1e0d-449b-990c-f610a3729135 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:32.413829 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8107fb45-1e0d-449b-990c-f610a3729135 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:32.415101 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8107fb45-1e0d-449b-990c-f610a3729135 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:32.415696 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8107fb45-1e0d-449b-990c-f610a3729135 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:32.422903 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:32.607353 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-8107fb45-1e0d-449b-990c-f610a3729135 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:32.625028 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-8107fb45-1e0d-449b-990c-f610a3729135 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a" status: 200 len: 1319 microversion: 2.1 time: 0.227020 Jul 31 18:44:32.637396 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 387/793] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:44:32 2022] GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:44:33.647677 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-a674a57c-9e27-4b9c-b147-14747bda390d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:33.649158 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-a674a57c-9e27-4b9c-b147-14747bda390d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: a9068580-2b7f-4645-9643-227c746fc56a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:33.655021 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell0:SELECT=2 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:33.655919 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell0:SELECT=6 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:33.656930 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:33.660172 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a674a57c-9e27-4b9c-b147-14747bda390d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:33.660529 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a674a57c-9e27-4b9c-b147-14747bda390d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:33.661634 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a674a57c-9e27-4b9c-b147-14747bda390d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:33.662349 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a674a57c-9e27-4b9c-b147-14747bda390d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:33.668812 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=91 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:33.980579 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-a674a57c-9e27-4b9c-b147-14747bda390d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:33.989588 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-a674a57c-9e27-4b9c-b147-14747bda390d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a" status: 200 len: 1509 microversion: 2.1 time: 0.345884 Jul 31 18:44:33.990158 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 407/794] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:44:33 2022] GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a => generated 1509 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:44:34.012325 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-7f97338a-7026-4a81-912c-04e8fc4afb27 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66a99ee1-3df0-4e0f-be01-3b25107a55a4", "device": "/dev/sdb"}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:44:34.014952 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-7f97338a-7026-4a81-912c-04e8fc4afb27 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: a9068580-2b7f-4645-9643-227c746fc56a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:34.023111 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell0:SELECT=2 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:34.026139 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7f97338a-7026-4a81-912c-04e8fc4afb27 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:34.028072 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7f97338a-7026-4a81-912c-04e8fc4afb27 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:34.029191 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7f97338a-7026-4a81-912c-04e8fc4afb27 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:34.029624 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7f97338a-7026-4a81-912c-04e8fc4afb27 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:34.317852 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-7f97338a-7026-4a81-912c-04e8fc4afb27 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "POST /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310725 Jul 31 18:44:34.319360 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 388/795] 10.222.0.49 () {60 vars in 1323 bytes} [Sun Jul 31 18:44:34 2022] POST /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:44:54.866793 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-71fdd368-d9e6-4c5c-92c5-3ca939c8bf4e tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:54.867336 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-71fdd368-d9e6-4c5c-92c5-3ca939c8bf4e tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: a9068580-2b7f-4645-9643-227c746fc56a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:54.869735 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=1 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:54.870393 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=5 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:54.875566 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-71fdd368-d9e6-4c5c-92c5-3ca939c8bf4e tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:54.876005 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-71fdd368-d9e6-4c5c-92c5-3ca939c8bf4e tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:54.876795 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-71fdd368-d9e6-4c5c-92c5-3ca939c8bf4e tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:54.877569 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-71fdd368-d9e6-4c5c-92c5-3ca939c8bf4e tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:54.976691 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.objects.instance [None req-71fdd368-d9e6-4c5c-92c5-3ca939c8bf4e tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lazy-loading 'services' on Instance uuid a9068580-2b7f-4645-9643-227c746fc56a {{(pid=124334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:44:55.062891 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-71fdd368-d9e6-4c5c-92c5-3ca939c8bf4e tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a/os-volume_attachments/66a99ee1-3df0-4e0f-be01-3b25107a55a4" status: 202 len: 0 microversion: 2.1 time: 0.199495 Jul 31 18:44:55.063626 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 408/796] 10.222.0.49 () {58 vars in 1416 bytes} [Sun Jul 31 18:44:54 2022] DELETE /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a/os-volume_attachments/66a99ee1-3df0-4e0f-be01-3b25107a55a4 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:44:56.198504 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-d7f30ef9-0e35-4cb7-86a2-814718c040da tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:56.199420 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-d7f30ef9-0e35-4cb7-86a2-814718c040da tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: a9068580-2b7f-4645-9643-227c746fc56a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:56.208320 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=3 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:56.209001 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:44:56.211236 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d7f30ef9-0e35-4cb7-86a2-814718c040da tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:56.211813 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d7f30ef9-0e35-4cb7-86a2-814718c040da tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:56.213180 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d7f30ef9-0e35-4cb7-86a2-814718c040da tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:56.213733 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d7f30ef9-0e35-4cb7-86a2-814718c040da tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:56.244572 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-d7f30ef9-0e35-4cb7-86a2-814718c040da tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: a9068580-2b7f-4645-9643-227c746fc56a] Going to try to terminate instance {{(pid=124333) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 18:44:56.365483 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-d7f30ef9-0e35-4cb7-86a2-814718c040da tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a" status: 204 len: 0 microversion: 2.1 time: 0.170002 Jul 31 18:44:56.366583 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 389/797] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:44:56 2022] DELETE /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 18:44:56.390204 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-a3bfebc6-83a6-425a-a9f4-333f98efa979 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:56.394064 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-a3bfebc6-83a6-425a-a9f4-333f98efa979 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: a9068580-2b7f-4645-9643-227c746fc56a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:56.416726 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a3bfebc6-83a6-425a-a9f4-333f98efa979 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:56.420722 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a3bfebc6-83a6-425a-a9f4-333f98efa979 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:56.421915 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a3bfebc6-83a6-425a-a9f4-333f98efa979 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:56.424647 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a3bfebc6-83a6-425a-a9f4-333f98efa979 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:56.617458 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-a3bfebc6-83a6-425a-a9f4-333f98efa979 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:56.626577 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-a3bfebc6-83a6-425a-a9f4-333f98efa979 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a" status: 200 len: 1515 microversion: 2.1 time: 0.254540 Jul 31 18:44:56.627889 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 409/798] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:44:56 2022] GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a => generated 1515 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:44:57.650519 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-6f615e6d-8bb4-453e-b5ad-0d5db86c0874 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:57.651998 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-6f615e6d-8bb4-453e-b5ad-0d5db86c0874 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: a9068580-2b7f-4645-9643-227c746fc56a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:57.660937 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6f615e6d-8bb4-453e-b5ad-0d5db86c0874 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:57.661421 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6f615e6d-8bb4-453e-b5ad-0d5db86c0874 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:57.662563 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6f615e6d-8bb4-453e-b5ad-0d5db86c0874 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:57.663102 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6f615e6d-8bb4-453e-b5ad-0d5db86c0874 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:57.869551 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-6f615e6d-8bb4-453e-b5ad-0d5db86c0874 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:57.880878 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-6f615e6d-8bb4-453e-b5ad-0d5db86c0874 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a" status: 200 len: 1515 microversion: 2.1 time: 0.234730 Jul 31 18:44:57.881472 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 390/799] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:44:57 2022] GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a => generated 1515 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:44:58.540108 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-4825ae60-325f-4a3b-9451-9d67818e72d5 req-8eef0f40-665f-4b7e-8add-9b13a49caf55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9068580-2b7f-4645-9643-227c746fc56a", "name": "network-vif-deleted", "tag": "3e173346-aa19-4fd0-8e9e-492bc2de5fdc"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:44:58.551112 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-4825ae60-325f-4a3b-9451-9d67818e72d5 req-8eef0f40-665f-4b7e-8add-9b13a49caf55 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:58.551550 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-4825ae60-325f-4a3b-9451-9d67818e72d5 req-8eef0f40-665f-4b7e-8add-9b13a49caf55 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:58.563715 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-4825ae60-325f-4a3b-9451-9d67818e72d5 req-8eef0f40-665f-4b7e-8add-9b13a49caf55 service nova] Creating event network-vif-deleted:3e173346-aa19-4fd0-8e9e-492bc2de5fdc for instance a9068580-2b7f-4645-9643-227c746fc56a on hv-cinder-84984 Jul 31 18:44:58.568904 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-4825ae60-325f-4a3b-9451-9d67818e72d5 req-8eef0f40-665f-4b7e-8add-9b13a49caf55 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032555 Jul 31 18:44:58.569526 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 410/800] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:44:58.910490 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-94604743-6238-446d-936e-18cf11a0ae0d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:44:58.911536 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-94604743-6238-446d-936e-18cf11a0ae0d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: a9068580-2b7f-4645-9643-227c746fc56a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:44:58.922730 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-94604743-6238-446d-936e-18cf11a0ae0d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:58.923472 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-94604743-6238-446d-936e-18cf11a0ae0d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:58.924718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-94604743-6238-446d-936e-18cf11a0ae0d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:44:58.925468 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-94604743-6238-446d-936e-18cf11a0ae0d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:44:58.992889 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-94604743-6238-446d-936e-18cf11a0ae0d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:44:59.000753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-94604743-6238-446d-936e-18cf11a0ae0d tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a" status: 200 len: 1473 microversion: 2.1 time: 0.097253 Jul 31 18:44:59.001349 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 391/801] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:44:58 2022] GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a => generated 1473 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:45:00.023722 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-3d769d61-0b41-4802-be3d-c08741d419de tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:45:00.024393 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-3d769d61-0b41-4802-be3d-c08741d419de tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: a9068580-2b7f-4645-9643-227c746fc56a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:45:00.033161 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3d769d61-0b41-4802-be3d-c08741d419de tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:00.033161 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3d769d61-0b41-4802-be3d-c08741d419de tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:00.033161 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3d769d61-0b41-4802-be3d-c08741d419de tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:00.033161 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3d769d61-0b41-4802-be3d-c08741d419de tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:00.095730 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-3d769d61-0b41-4802-be3d-c08741d419de tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:45:00.105979 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-3d769d61-0b41-4802-be3d-c08741d419de tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a" status: 200 len: 1304 microversion: 2.1 time: 0.086487 Jul 31 18:45:00.106742 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 411/802] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:45:00 2022] GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a => generated 1304 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:45:01.128021 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-9902252a-8356-4b9f-9a2c-df4f6b600440 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:45:01.128601 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-9902252a-8356-4b9f-9a2c-df4f6b600440 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: a9068580-2b7f-4645-9643-227c746fc56a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:45:01.135599 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9902252a-8356-4b9f-9a2c-df4f6b600440 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:01.136045 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9902252a-8356-4b9f-9a2c-df4f6b600440 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:01.136807 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9902252a-8356-4b9f-9a2c-df4f6b600440 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:01.137272 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9902252a-8356-4b9f-9a2c-df4f6b600440 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:01.170482 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9902252a-8356-4b9f-9a2c-df4f6b600440 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:01.170922 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9902252a-8356-4b9f-9a2c-df4f6b600440 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:01.171355 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.objects.instance [None req-9902252a-8356-4b9f-9a2c-df4f6b600440 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lazy-loading 'fault' on Instance uuid a9068580-2b7f-4645-9643-227c746fc56a {{(pid=124333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:45:01.215564 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-9902252a-8356-4b9f-9a2c-df4f6b600440 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3517f51b74230964f1e2b29371e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540ab0260cc4c0ca76036b79bb5f506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:45:01.224161 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-9902252a-8356-4b9f-9a2c-df4f6b600440 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a" status: 200 len: 1309 microversion: 2.1 time: 0.100387 Jul 31 18:45:01.225248 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 392/803] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:45:01 2022] GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:45:02.246274 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4966953f-449c-4255-a26d-6fe68f75d8e3 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:45:02.246883 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-4966953f-449c-4255-a26d-6fe68f75d8e3 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] [instance: a9068580-2b7f-4645-9643-227c746fc56a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:45:02.253506 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4966953f-449c-4255-a26d-6fe68f75d8e3 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:02.254008 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4966953f-449c-4255-a26d-6fe68f75d8e3 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:02.254754 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4966953f-449c-4255-a26d-6fe68f75d8e3 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:02.255306 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4966953f-449c-4255-a26d-6fe68f75d8e3 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:02.269846 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-4966953f-449c-4255-a26d-6fe68f75d8e3 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] HTTP exception thrown: Instance a9068580-2b7f-4645-9643-227c746fc56a could not be found. Jul 31 18:45:02.271895 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4966953f-449c-4255-a26d-6fe68f75d8e3 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Request method failure captured: Jul 31 18:45:02.271895 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a HTTP/1.1 Jul 31 18:45:02.271895 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:45:02.271895 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:45:02.271895 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:45:02.271895 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 0 Jul 31 18:45:02.271895 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:45:02.271895 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:45:02.271895 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:45:02.271895 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:45:02.271895 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5s06uxot3oQZfPN59024hg7hBMQc79gbzIVslNHIfAEqyhe-Co-wrtAIMGi5P8url8eFmdvwTA-sc5HxdwAhBgmW3_lbRrC55tCg9wwcI4yxxHwIZTkxhXbdEszLVbmFpkw_UG853uvVZEfMaZ5wsDUCcxXZ-yrf0XZvCmId9O1OUF0 Jul 31 18:45:02.271895 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:45:02.271895 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:45:02.271895 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:45:02.271895 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:45:02.271895 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:45:02.271895 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:45:02.271895 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: 9540ab0260cc4c0ca76036b79bb5f506 Jul 31 18:45:02.271895 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-VolumesSnapshotTestJSON-805065598 Jul 31 18:45:02.271895 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:45:02.271895 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:45:02.273573 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9540ab0260cc4c0ca76036b79bb5f506"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9540ab0260cc4c0ca76036b79bb5f506", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9540ab0260cc4c0ca76036b79bb5f506"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9540ab0260cc4c0ca76036b79bb5f506"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:45:02.273573 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-VolumesSnapshotTestJSON-805065598 Jul 31 18:45:02.273573 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: 9540ab0260cc4c0ca76036b79bb5f506 Jul 31 18:45:02.273573 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-805065598 Jul 31 18:45:02.273573 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-VolumesSnapshotTestJSON-805065598-project Jul 31 18:45:02.273573 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:45:02.273573 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:45:02.273573 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: f5d3517f51b74230964f1e2b29371e0b Jul 31 18:45:02.273573 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-VolumesSnapshotTestJSON-805065598-project Jul 31 18:45:02.273573 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: > Jul 31 18:45:02.273573 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Instance a9068580-2b7f-4645-9643-227c746fc56a could not be found. Jul 31 18:45:02.273573 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'id': 'a9068580-2b7f-4645-9643-227c746fc56a'} Jul 31 18:45:02.274439 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:45:02.274439 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:45:02.274439 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:45:02.274439 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:45:02.274439 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:45:02.274439 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:45:02.274439 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:45:02.274439 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:45:02.274439 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:45:02.274439 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:45:02.274439 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9068580-2b7f-4645-9643-227c746fc56a could not be found. Jul 31 18:45:02.274439 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:45:02.274439 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:45:02.274439 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:45:02.274439 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:45:02.274439 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:45:02.274439 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:45:02.274439 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:45:02.274439 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:45:02.274439 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:45:02.275732 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:45:02.275732 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:45:02.275732 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:45:02.275732 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:45:02.275732 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:45:02.275732 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:45:02.275732 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:45:02.275732 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9068580-2b7f-4645-9643-227c746fc56a could not be found. Jul 31 18:45:02.275732 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:45:02.275732 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:45:02.275732 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:45:02.275732 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:45:02.275732 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:45:02.275732 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:45:02.275732 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:45:02.275732 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:45:02.275732 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9068580-2b7f-4645-9643-227c746fc56a could not be found. Jul 31 18:45:02.275732 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:45:02.277377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4966953f-449c-4255-a26d-6fe68f75d8e3 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] Returning 404 to user: Instance a9068580-2b7f-4645-9643-227c746fc56a could not be found. {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:45:02.277377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-4966953f-449c-4255-a26d-6fe68f75d8e3 tempest-VolumesSnapshotTestJSON-805065598 tempest-VolumesSnapshotTestJSON-805065598-project] 10.222.0.49 "GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a" status: 404 len: 111 microversion: 2.1 time: 0.032090 Jul 31 18:45:02.277377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 412/804] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:45:02 2022] GET /compute/v2.1/servers/a9068580-2b7f-4645-9643-227c746fc56a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:45:12.834507 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-7c135f82-08cc-4412-a06d-6c8885221c6f tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1560937911", "imageRef": "6f2a0bb6-2fb3-4536-bee3-23e4e975f079", "flavorRef": "452"}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:45:12.841656 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:45:12.842298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:45:12.892900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.network.neutron [None req-7c135f82-08cc-4412-a06d-6c8885221c6f tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] validate_networks() for None {{(pid=124333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 18:45:13.167960 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-7c135f82-08cc-4412-a06d-6c8885221c6f tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Flavor limits 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 18:45:13.168374 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-7c135f82-08cc-4412-a06d-6c8885221c6f tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Image limits 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 18:45:13.168845 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-7c135f82-08cc-4412-a06d-6c8885221c6f tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Flavor pref 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 18:45:13.169246 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-7c135f82-08cc-4412-a06d-6c8885221c6f tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Image pref 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 18:45:13.169640 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-7c135f82-08cc-4412-a06d-6c8885221c6f tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 18:45:13.180724 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7c135f82-08cc-4412-a06d-6c8885221c6f tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:13.181194 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7c135f82-08cc-4412-a06d-6c8885221c6f tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:13.181993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7c135f82-08cc-4412-a06d-6c8885221c6f tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:13.182425 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-7c135f82-08cc-4412-a06d-6c8885221c6f tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:13.199406 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-7c135f82-08cc-4412-a06d-6c8885221c6f tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Getting quotas for project 6a503222f5964076a75d291a6530097c. Resources: {'cores', 'ram', 'instances'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:45:13.203486 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-7c135f82-08cc-4412-a06d-6c8885221c6f tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Getting quotas for user c7dd082069b3423a8686cd809c8d4110 and project 6a503222f5964076a75d291a6530097c. Resources: {'cores', 'ram', 'instances'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:45:13.214811 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-7c135f82-08cc-4412-a06d-6c8885221c6f tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Going to run 1 instances... {{(pid=124333) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 18:45:13.217165 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-7c135f82-08cc-4412-a06d-6c8885221c6f tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] [instance: c4dd49d5-fe53-423c-9ced-8f99609865ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f2a0bb6-2fb3-4536-bee3-23e4e975f079',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 18:45:13.261324 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-7c135f82-08cc-4412-a06d-6c8885221c6f tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.430676 Jul 31 18:45:13.262935 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 393/805] 10.222.0.49 () {60 vars in 1147 bytes} [Sun Jul 31 18:45:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 18:45:13.274499 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-77f44624-7551-4c91-93ca-f32c4afb3a40 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:45:13.276095 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-77f44624-7551-4c91-93ca-f32c4afb3a40 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] [instance: c4dd49d5-fe53-423c-9ced-8f99609865ef] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:45:13.280045 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=10 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:45:13.281262 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=1 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:45:13.341454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-77f44624-7551-4c91-93ca-f32c4afb3a40 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dd082069b3423a8686cd809c8d4110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a503222f5964076a75d291a6530097c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:45:13.348641 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-77f44624-7551-4c91-93ca-f32c4afb3a40 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] 10.222.0.49 "GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef" status: 200 len: 1215 microversion: 2.1 time: 0.079112 Jul 31 18:45:13.349234 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 413/806] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:45:13 2022] GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef => generated 1215 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:45:14.370128 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-29d607eb-a07d-4015-b500-2d212b90d3cd tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:45:14.370806 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-29d607eb-a07d-4015-b500-2d212b90d3cd tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] [instance: c4dd49d5-fe53-423c-9ced-8f99609865ef] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:45:14.377575 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-29d607eb-a07d-4015-b500-2d212b90d3cd tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:14.378035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-29d607eb-a07d-4015-b500-2d212b90d3cd tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:14.378863 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-29d607eb-a07d-4015-b500-2d212b90d3cd tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:14.379297 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-29d607eb-a07d-4015-b500-2d212b90d3cd tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:14.440365 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-29d607eb-a07d-4015-b500-2d212b90d3cd tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dd082069b3423a8686cd809c8d4110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a503222f5964076a75d291a6530097c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:45:14.448304 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-29d607eb-a07d-4015-b500-2d212b90d3cd tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] 10.222.0.49 "GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef" status: 200 len: 1267 microversion: 2.1 time: 0.082612 Jul 31 18:45:14.448967 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 394/807] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:45:14 2022] GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:45:15.474018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-acc00d94-14b1-43a3-8b45-043d502ca833 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:45:15.474889 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-acc00d94-14b1-43a3-8b45-043d502ca833 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] [instance: c4dd49d5-fe53-423c-9ced-8f99609865ef] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:45:15.487213 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-acc00d94-14b1-43a3-8b45-043d502ca833 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:15.488105 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-acc00d94-14b1-43a3-8b45-043d502ca833 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:15.488901 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-acc00d94-14b1-43a3-8b45-043d502ca833 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:15.489339 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-acc00d94-14b1-43a3-8b45-043d502ca833 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:15.554271 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-acc00d94-14b1-43a3-8b45-043d502ca833 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dd082069b3423a8686cd809c8d4110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a503222f5964076a75d291a6530097c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:45:15.565250 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-acc00d94-14b1-43a3-8b45-043d502ca833 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] 10.222.0.49 "GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef" status: 200 len: 1267 microversion: 2.1 time: 0.097696 Jul 31 18:45:15.566037 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 414/808] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:45:15 2022] GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef => generated 1267 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:45:16.596489 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-2c2ac194-d812-4b96-b498-01aad69bab24 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:45:16.598892 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-2c2ac194-d812-4b96-b498-01aad69bab24 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] [instance: c4dd49d5-fe53-423c-9ced-8f99609865ef] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:45:16.606242 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2c2ac194-d812-4b96-b498-01aad69bab24 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:16.606684 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2c2ac194-d812-4b96-b498-01aad69bab24 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:16.607680 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2c2ac194-d812-4b96-b498-01aad69bab24 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:16.608327 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2c2ac194-d812-4b96-b498-01aad69bab24 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:16.682419 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-2c2ac194-d812-4b96-b498-01aad69bab24 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dd082069b3423a8686cd809c8d4110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a503222f5964076a75d291a6530097c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:45:16.692020 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-2c2ac194-d812-4b96-b498-01aad69bab24 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] 10.222.0.49 "GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef" status: 200 len: 1267 microversion: 2.1 time: 0.102884 Jul 31 18:45:16.692793 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 395/809] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:45:16 2022] GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef => generated 1267 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:45:17.714712 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-b267ff87-21f3-4130-9b6c-663de211f33e tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:45:17.715411 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-b267ff87-21f3-4130-9b6c-663de211f33e tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] [instance: c4dd49d5-fe53-423c-9ced-8f99609865ef] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:45:17.722295 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b267ff87-21f3-4130-9b6c-663de211f33e tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:17.722862 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b267ff87-21f3-4130-9b6c-663de211f33e tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:17.723694 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b267ff87-21f3-4130-9b6c-663de211f33e tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:17.724186 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b267ff87-21f3-4130-9b6c-663de211f33e tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:17.863295 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-b267ff87-21f3-4130-9b6c-663de211f33e tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dd082069b3423a8686cd809c8d4110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a503222f5964076a75d291a6530097c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:45:17.873534 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-b267ff87-21f3-4130-9b6c-663de211f33e tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] 10.222.0.49 "GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef" status: 200 len: 1315 microversion: 2.1 time: 0.162601 Jul 31 18:45:17.874514 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 415/810] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:45:17 2022] GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:45:18.899138 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-31438043-8c82-405c-a01f-773c3a8f36f4 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:45:18.900143 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-31438043-8c82-405c-a01f-773c3a8f36f4 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] [instance: c4dd49d5-fe53-423c-9ced-8f99609865ef] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:45:18.911170 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-31438043-8c82-405c-a01f-773c3a8f36f4 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:18.911633 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-31438043-8c82-405c-a01f-773c3a8f36f4 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:18.912405 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-31438043-8c82-405c-a01f-773c3a8f36f4 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:18.912867 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-31438043-8c82-405c-a01f-773c3a8f36f4 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:19.059510 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-31438043-8c82-405c-a01f-773c3a8f36f4 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dd082069b3423a8686cd809c8d4110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a503222f5964076a75d291a6530097c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:45:19.070100 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-31438043-8c82-405c-a01f-773c3a8f36f4 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] 10.222.0.49 "GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef" status: 200 len: 1315 microversion: 2.1 time: 0.177553 Jul 31 18:45:19.070669 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 396/811] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:45:18 2022] GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:45:19.935543 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-c5dd30e8-2e27-4c23-b616-e91aad5ff5d2 req-079a237d-4ec5-448d-9620-df2581673c50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4dd49d5-fe53-423c-9ced-8f99609865ef", "tag": "958a06e8-8201-4a01-9d30-9276230c124d"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:45:19.945737 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-c5dd30e8-2e27-4c23-b616-e91aad5ff5d2 req-079a237d-4ec5-448d-9620-df2581673c50 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:19.946169 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-c5dd30e8-2e27-4c23-b616-e91aad5ff5d2 req-079a237d-4ec5-448d-9620-df2581673c50 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:19.957196 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-c5dd30e8-2e27-4c23-b616-e91aad5ff5d2 req-079a237d-4ec5-448d-9620-df2581673c50 service nova] Creating event network-changed:958a06e8-8201-4a01-9d30-9276230c124d for instance c4dd49d5-fe53-423c-9ced-8f99609865ef on hv-cinder-84984 Jul 31 18:45:19.962274 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-c5dd30e8-2e27-4c23-b616-e91aad5ff5d2 req-079a237d-4ec5-448d-9620-df2581673c50 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030587 Jul 31 18:45:19.962844 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 416/812] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:45:20.094741 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-8b89f350-a819-4f2c-bae2-8d708b84d497 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:45:20.095665 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-8b89f350-a819-4f2c-bae2-8d708b84d497 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] [instance: c4dd49d5-fe53-423c-9ced-8f99609865ef] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:45:20.106078 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8b89f350-a819-4f2c-bae2-8d708b84d497 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:20.106808 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8b89f350-a819-4f2c-bae2-8d708b84d497 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:20.107946 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8b89f350-a819-4f2c-bae2-8d708b84d497 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:20.108615 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8b89f350-a819-4f2c-bae2-8d708b84d497 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:20.242867 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-8b89f350-a819-4f2c-bae2-8d708b84d497 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dd082069b3423a8686cd809c8d4110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a503222f5964076a75d291a6530097c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:45:20.250429 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-8b89f350-a819-4f2c-bae2-8d708b84d497 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] 10.222.0.49 "GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef" status: 200 len: 1315 microversion: 2.1 time: 0.161846 Jul 31 18:45:20.251004 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 397/813] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:45:20 2022] GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:45:21.273219 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-51059ea1-54fa-4426-952f-0b42f12b501c tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:45:21.273924 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-51059ea1-54fa-4426-952f-0b42f12b501c tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] [instance: c4dd49d5-fe53-423c-9ced-8f99609865ef] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:45:21.280724 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-51059ea1-54fa-4426-952f-0b42f12b501c tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:21.281196 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-51059ea1-54fa-4426-952f-0b42f12b501c tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:21.281963 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-51059ea1-54fa-4426-952f-0b42f12b501c tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:21.282393 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-51059ea1-54fa-4426-952f-0b42f12b501c tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:21.416130 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-51059ea1-54fa-4426-952f-0b42f12b501c tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dd082069b3423a8686cd809c8d4110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a503222f5964076a75d291a6530097c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:45:21.424021 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-51059ea1-54fa-4426-952f-0b42f12b501c tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] 10.222.0.49 "GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef" status: 200 len: 1315 microversion: 2.1 time: 0.155583 Jul 31 18:45:21.424601 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 417/814] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:45:21 2022] GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:45:22.448626 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-e43ae9f2-68b7-49a0-a52e-5fd1152671d7 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:45:22.449611 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-e43ae9f2-68b7-49a0-a52e-5fd1152671d7 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] [instance: c4dd49d5-fe53-423c-9ced-8f99609865ef] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:45:22.459749 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e43ae9f2-68b7-49a0-a52e-5fd1152671d7 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:22.460195 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e43ae9f2-68b7-49a0-a52e-5fd1152671d7 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:22.460993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e43ae9f2-68b7-49a0-a52e-5fd1152671d7 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:22.461445 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e43ae9f2-68b7-49a0-a52e-5fd1152671d7 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:22.603969 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-e43ae9f2-68b7-49a0-a52e-5fd1152671d7 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dd082069b3423a8686cd809c8d4110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a503222f5964076a75d291a6530097c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:45:22.612016 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-e43ae9f2-68b7-49a0-a52e-5fd1152671d7 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] 10.222.0.49 "GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef" status: 200 len: 1315 microversion: 2.1 time: 0.169863 Jul 31 18:45:22.612604 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 398/815] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:45:22 2022] GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:45:23.633241 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-cacf5757-a469-4ac1-a96a-ab34e0957251 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:45:23.633848 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-cacf5757-a469-4ac1-a96a-ab34e0957251 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] [instance: c4dd49d5-fe53-423c-9ced-8f99609865ef] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:45:23.636483 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell0:SELECT=2 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:45:23.642863 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cacf5757-a469-4ac1-a96a-ab34e0957251 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:23.643302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cacf5757-a469-4ac1-a96a-ab34e0957251 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:23.644105 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cacf5757-a469-4ac1-a96a-ab34e0957251 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:23.644541 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cacf5757-a469-4ac1-a96a-ab34e0957251 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:23.788948 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-cacf5757-a469-4ac1-a96a-ab34e0957251 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dd082069b3423a8686cd809c8d4110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a503222f5964076a75d291a6530097c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:45:23.808673 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-cacf5757-a469-4ac1-a96a-ab34e0957251 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] 10.222.0.49 "GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef" status: 200 len: 1315 microversion: 2.1 time: 0.179313 Jul 31 18:45:23.809321 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 418/816] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:45:23 2022] GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:45:24.833917 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-4edca8c4-476b-4e28-bcaa-f54c37ffa004 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:45:24.834880 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-4edca8c4-476b-4e28-bcaa-f54c37ffa004 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] [instance: c4dd49d5-fe53-423c-9ced-8f99609865ef] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:45:24.837900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell0:SELECT=2 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:45:24.839143 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell0:SELECT=6 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:45:24.849650 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4edca8c4-476b-4e28-bcaa-f54c37ffa004 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:24.850081 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4edca8c4-476b-4e28-bcaa-f54c37ffa004 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:24.850836 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4edca8c4-476b-4e28-bcaa-f54c37ffa004 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:24.851260 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4edca8c4-476b-4e28-bcaa-f54c37ffa004 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:24.996286 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-4edca8c4-476b-4e28-bcaa-f54c37ffa004 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dd082069b3423a8686cd809c8d4110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a503222f5964076a75d291a6530097c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:45:25.004543 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-4edca8c4-476b-4e28-bcaa-f54c37ffa004 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] 10.222.0.49 "GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef" status: 200 len: 1315 microversion: 2.1 time: 0.177408 Jul 31 18:45:25.005243 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 399/817] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:45:24 2022] GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:45:26.034282 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-89c0b011-19fd-48b3-8b0f-323f6d2ad353 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:45:26.035129 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-89c0b011-19fd-48b3-8b0f-323f6d2ad353 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] [instance: c4dd49d5-fe53-423c-9ced-8f99609865ef] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:45:26.045296 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-89c0b011-19fd-48b3-8b0f-323f6d2ad353 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:26.045908 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-89c0b011-19fd-48b3-8b0f-323f6d2ad353 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:26.051403 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-89c0b011-19fd-48b3-8b0f-323f6d2ad353 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:26.051403 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-89c0b011-19fd-48b3-8b0f-323f6d2ad353 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:26.188451 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-89c0b011-19fd-48b3-8b0f-323f6d2ad353 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dd082069b3423a8686cd809c8d4110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a503222f5964076a75d291a6530097c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:45:26.196585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-89c0b011-19fd-48b3-8b0f-323f6d2ad353 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] 10.222.0.49 "GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef" status: 200 len: 1315 microversion: 2.1 time: 0.167740 Jul 31 18:45:26.197196 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 419/818] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:45:26 2022] GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:45:27.221796 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-3d109890-0e83-43d9-9387-1c55d6d5f993 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:45:27.222577 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-3d109890-0e83-43d9-9387-1c55d6d5f993 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] [instance: c4dd49d5-fe53-423c-9ced-8f99609865ef] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:45:27.230201 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3d109890-0e83-43d9-9387-1c55d6d5f993 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:27.232097 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3d109890-0e83-43d9-9387-1c55d6d5f993 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:27.232097 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3d109890-0e83-43d9-9387-1c55d6d5f993 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:27.232097 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3d109890-0e83-43d9-9387-1c55d6d5f993 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:27.366745 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-3d109890-0e83-43d9-9387-1c55d6d5f993 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dd082069b3423a8686cd809c8d4110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a503222f5964076a75d291a6530097c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:45:27.375223 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-3d109890-0e83-43d9-9387-1c55d6d5f993 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] 10.222.0.49 "GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef" status: 200 len: 1315 microversion: 2.1 time: 0.159973 Jul 31 18:45:27.375801 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 400/819] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:45:27 2022] GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:45:28.400028 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-be06423a-bce8-434f-b01e-cf43ed207391 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:45:28.400978 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-be06423a-bce8-434f-b01e-cf43ed207391 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] [instance: c4dd49d5-fe53-423c-9ced-8f99609865ef] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:45:28.408978 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-be06423a-bce8-434f-b01e-cf43ed207391 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:28.409650 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-be06423a-bce8-434f-b01e-cf43ed207391 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:28.410427 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-be06423a-bce8-434f-b01e-cf43ed207391 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:28.410915 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-be06423a-bce8-434f-b01e-cf43ed207391 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:28.631326 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-be06423a-bce8-434f-b01e-cf43ed207391 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dd082069b3423a8686cd809c8d4110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a503222f5964076a75d291a6530097c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:45:28.639685 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-be06423a-bce8-434f-b01e-cf43ed207391 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] 10.222.0.49 "GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef" status: 200 len: 1315 microversion: 2.1 time: 0.245217 Jul 31 18:45:28.640255 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 420/820] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:45:28 2022] GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:45:29.659891 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-2dea297e-a05a-467f-87ba-39b29dc452a0 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:45:29.661112 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-2dea297e-a05a-467f-87ba-39b29dc452a0 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] [instance: c4dd49d5-fe53-423c-9ced-8f99609865ef] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:45:29.672281 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2dea297e-a05a-467f-87ba-39b29dc452a0 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:29.672718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2dea297e-a05a-467f-87ba-39b29dc452a0 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:29.673515 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2dea297e-a05a-467f-87ba-39b29dc452a0 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:29.673941 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2dea297e-a05a-467f-87ba-39b29dc452a0 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:29.840553 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-2dea297e-a05a-467f-87ba-39b29dc452a0 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dd082069b3423a8686cd809c8d4110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a503222f5964076a75d291a6530097c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:45:29.848540 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-2dea297e-a05a-467f-87ba-39b29dc452a0 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] 10.222.0.49 "GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef" status: 200 len: 1315 microversion: 2.1 time: 0.192854 Jul 31 18:45:29.851936 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 401/821] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:45:29 2022] GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:45:30.017109 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-6f704be4-388f-4707-a286-fa5dc40102cd req-977e575e-6132-49c6-95a3-01d4d0110d6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4dd49d5-fe53-423c-9ced-8f99609865ef", "name": "network-vif-plugged", "status": "completed", "tag": "958a06e8-8201-4a01-9d30-9276230c124d"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:45:30.028546 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-6f704be4-388f-4707-a286-fa5dc40102cd req-977e575e-6132-49c6-95a3-01d4d0110d6e service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:30.028991 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-6f704be4-388f-4707-a286-fa5dc40102cd req-977e575e-6132-49c6-95a3-01d4d0110d6e service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:30.041322 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-6f704be4-388f-4707-a286-fa5dc40102cd req-977e575e-6132-49c6-95a3-01d4d0110d6e service nova] Creating event network-vif-plugged:958a06e8-8201-4a01-9d30-9276230c124d for instance c4dd49d5-fe53-423c-9ced-8f99609865ef on hv-cinder-84984 Jul 31 18:45:30.047110 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-6f704be4-388f-4707-a286-fa5dc40102cd req-977e575e-6132-49c6-95a3-01d4d0110d6e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033698 Jul 31 18:45:30.048092 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 421/822] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:45:30.873892 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-b87a0082-af4f-46be-8a0f-187e618ae494 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:45:30.875847 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-b87a0082-af4f-46be-8a0f-187e618ae494 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] [instance: c4dd49d5-fe53-423c-9ced-8f99609865ef] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:45:30.886584 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b87a0082-af4f-46be-8a0f-187e618ae494 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:30.887342 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b87a0082-af4f-46be-8a0f-187e618ae494 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:30.888742 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b87a0082-af4f-46be-8a0f-187e618ae494 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:30.890006 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b87a0082-af4f-46be-8a0f-187e618ae494 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:31.176269 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-b87a0082-af4f-46be-8a0f-187e618ae494 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dd082069b3423a8686cd809c8d4110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a503222f5964076a75d291a6530097c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:45:31.192204 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-b87a0082-af4f-46be-8a0f-187e618ae494 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] 10.222.0.49 "GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef" status: 200 len: 1315 microversion: 2.1 time: 0.324380 Jul 31 18:45:31.208291 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 402/823] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:45:30 2022] GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:45:32.225016 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f1d313a5-c45a-4478-a0be-623915ce703b tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:45:32.229101 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-f1d313a5-c45a-4478-a0be-623915ce703b tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] [instance: c4dd49d5-fe53-423c-9ced-8f99609865ef] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:45:32.249580 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f1d313a5-c45a-4478-a0be-623915ce703b tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:32.250222 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f1d313a5-c45a-4478-a0be-623915ce703b tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:32.251295 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f1d313a5-c45a-4478-a0be-623915ce703b tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:32.252268 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f1d313a5-c45a-4478-a0be-623915ce703b tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:32.448052 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-f1d313a5-c45a-4478-a0be-623915ce703b tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dd082069b3423a8686cd809c8d4110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a503222f5964076a75d291a6530097c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:45:32.459267 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-f1d313a5-c45a-4478-a0be-623915ce703b tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] 10.222.0.49 "GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef" status: 200 len: 1464 microversion: 2.1 time: 0.248314 Jul 31 18:45:32.473787 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 422/824] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:45:32 2022] GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef => generated 1464 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:45:32.522582 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-f322f0e1-e0ef-4a9f-b2b5-c0db4e57ef4c tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:45:32.524178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-f322f0e1-e0ef-4a9f-b2b5-c0db4e57ef4c tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] [instance: c4dd49d5-fe53-423c-9ced-8f99609865ef] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:45:32.537408 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f322f0e1-e0ef-4a9f-b2b5-c0db4e57ef4c tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:32.538557 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f322f0e1-e0ef-4a9f-b2b5-c0db4e57ef4c tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:32.539573 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f322f0e1-e0ef-4a9f-b2b5-c0db4e57ef4c tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:32.540249 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f322f0e1-e0ef-4a9f-b2b5-c0db4e57ef4c tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:32.605350 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-f322f0e1-e0ef-4a9f-b2b5-c0db4e57ef4c tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] [instance: c4dd49d5-fe53-423c-9ced-8f99609865ef] Going to try to terminate instance {{(pid=124333) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 18:45:32.802375 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-f322f0e1-e0ef-4a9f-b2b5-c0db4e57ef4c tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef" status: 204 len: 0 microversion: 2.1 time: 0.282992 Jul 31 18:45:32.813737 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-580dac8a-44b7-4170-8bb6-28e12aea911e tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:45:32.814707 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-580dac8a-44b7-4170-8bb6-28e12aea911e tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] [instance: c4dd49d5-fe53-423c-9ced-8f99609865ef] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:45:32.818317 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 403/825] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:45:32 2022] DELETE /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 18:45:32.826348 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-580dac8a-44b7-4170-8bb6-28e12aea911e tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:32.826832 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-580dac8a-44b7-4170-8bb6-28e12aea911e tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:32.828338 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-580dac8a-44b7-4170-8bb6-28e12aea911e tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:32.828910 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-580dac8a-44b7-4170-8bb6-28e12aea911e tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:33.006551 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-580dac8a-44b7-4170-8bb6-28e12aea911e tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dd082069b3423a8686cd809c8d4110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a503222f5964076a75d291a6530097c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:45:33.016276 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-580dac8a-44b7-4170-8bb6-28e12aea911e tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] 10.222.0.49 "GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef" status: 200 len: 1470 microversion: 2.1 time: 0.207912 Jul 31 18:45:33.019152 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 423/826] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:45:32 2022] GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef => generated 1470 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:45:34.050500 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-c1e82d66-2213-43ad-83df-08a1690666c3 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:45:34.051462 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-c1e82d66-2213-43ad-83df-08a1690666c3 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] [instance: c4dd49d5-fe53-423c-9ced-8f99609865ef] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:45:34.059052 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c1e82d66-2213-43ad-83df-08a1690666c3 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:34.059597 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c1e82d66-2213-43ad-83df-08a1690666c3 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:34.060596 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c1e82d66-2213-43ad-83df-08a1690666c3 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:34.060998 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c1e82d66-2213-43ad-83df-08a1690666c3 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:34.398903 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-c1e82d66-2213-43ad-83df-08a1690666c3 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dd082069b3423a8686cd809c8d4110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a503222f5964076a75d291a6530097c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:45:34.420627 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-c1e82d66-2213-43ad-83df-08a1690666c3 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] 10.222.0.49 "GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef" status: 200 len: 1470 microversion: 2.1 time: 0.376820 Jul 31 18:45:34.437650 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 404/827] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:45:34 2022] GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef => generated 1470 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:45:35.297837 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-c3a19555-bcb3-4cc5-8710-6c956097034a req-594f8aa5-06b8-42fa-ae4f-b48c3f46fd19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4dd49d5-fe53-423c-9ced-8f99609865ef", "name": "network-vif-deleted", "tag": "958a06e8-8201-4a01-9d30-9276230c124d"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:45:35.315543 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-c3a19555-bcb3-4cc5-8710-6c956097034a req-594f8aa5-06b8-42fa-ae4f-b48c3f46fd19 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:35.316191 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-c3a19555-bcb3-4cc5-8710-6c956097034a req-594f8aa5-06b8-42fa-ae4f-b48c3f46fd19 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:35.343002 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-c3a19555-bcb3-4cc5-8710-6c956097034a req-594f8aa5-06b8-42fa-ae4f-b48c3f46fd19 service nova] Creating event network-vif-deleted:958a06e8-8201-4a01-9d30-9276230c124d for instance c4dd49d5-fe53-423c-9ced-8f99609865ef on hv-cinder-84984 Jul 31 18:45:35.352219 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-c3a19555-bcb3-4cc5-8710-6c956097034a req-594f8aa5-06b8-42fa-ae4f-b48c3f46fd19 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060221 Jul 31 18:45:35.353223 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 424/828] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:45:35.449083 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-10a32718-bee6-4f09-bffa-cac98e249d71 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:45:35.450824 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-10a32718-bee6-4f09-bffa-cac98e249d71 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] [instance: c4dd49d5-fe53-423c-9ced-8f99609865ef] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:45:35.469511 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-10a32718-bee6-4f09-bffa-cac98e249d71 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:35.470148 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-10a32718-bee6-4f09-bffa-cac98e249d71 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:35.471098 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-10a32718-bee6-4f09-bffa-cac98e249d71 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:35.471681 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-10a32718-bee6-4f09-bffa-cac98e249d71 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:35.508316 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-10a32718-bee6-4f09-bffa-cac98e249d71 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:35.508981 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-10a32718-bee6-4f09-bffa-cac98e249d71 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:35.509419 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.objects.instance [None req-10a32718-bee6-4f09-bffa-cac98e249d71 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lazy-loading 'fault' on Instance uuid c4dd49d5-fe53-423c-9ced-8f99609865ef {{(pid=124333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:45:35.556667 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-10a32718-bee6-4f09-bffa-cac98e249d71 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dd082069b3423a8686cd809c8d4110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a503222f5964076a75d291a6530097c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:45:35.564977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-10a32718-bee6-4f09-bffa-cac98e249d71 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] 10.222.0.49 "GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef" status: 200 len: 1305 microversion: 2.1 time: 0.121524 Jul 31 18:45:35.565560 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 405/829] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:45:35 2022] GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef => generated 1305 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:45:36.588472 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-54481a68-30df-4adf-b752-746ca13f36e1 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:45:36.590539 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-54481a68-30df-4adf-b752-746ca13f36e1 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] [instance: c4dd49d5-fe53-423c-9ced-8f99609865ef] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:45:36.601976 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-54481a68-30df-4adf-b752-746ca13f36e1 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:36.603184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-54481a68-30df-4adf-b752-746ca13f36e1 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:36.604904 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-54481a68-30df-4adf-b752-746ca13f36e1 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:45:36.606033 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-54481a68-30df-4adf-b752-746ca13f36e1 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:45:36.630590 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-54481a68-30df-4adf-b752-746ca13f36e1 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] HTTP exception thrown: Instance c4dd49d5-fe53-423c-9ced-8f99609865ef could not be found. Jul 31 18:45:36.635939 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-54481a68-30df-4adf-b752-746ca13f36e1 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Request method failure captured: Jul 31 18:45:36.635939 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef HTTP/1.1 Jul 31 18:45:36.635939 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:45:36.635939 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:45:36.635939 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:45:36.635939 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 0 Jul 31 18:45:36.635939 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:45:36.635939 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:45:36.635939 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:45:36.635939 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:45:36.635939 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5s23YMXlBGDp4PKr7oejFHFBgKkn_KFoG8oz-I5cnIAvggGNMH00xlvcFXvS1YlG15OYu3jAKJIe_Y9jNKNVxRWmQRHWMef4rMHKEb0IQ15zdDcy-xpKHF_MqS9EsdSRaJ-x7Q7kL8DljmLybm8KRP2zUM6zoFoWFwoDmYUmkxxbKaI Jul 31 18:45:36.635939 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:45:36.635939 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:45:36.635939 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:45:36.635939 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:45:36.635939 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:45:36.635939 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:45:36.635939 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: 6a503222f5964076a75d291a6530097c Jul 31 18:45:36.635939 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-VolumesNegativeTest-1813299338 Jul 31 18:45:36.635939 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:45:36.635939 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:45:36.637370 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6a503222f5964076a75d291a6530097c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6a503222f5964076a75d291a6530097c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6a503222f5964076a75d291a6530097c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6a503222f5964076a75d291a6530097c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:45:36.637370 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-VolumesNegativeTest-1813299338 Jul 31 18:45:36.637370 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: 6a503222f5964076a75d291a6530097c Jul 31 18:45:36.637370 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-VolumesNegativeTest-1813299338 Jul 31 18:45:36.637370 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-VolumesNegativeTest-1813299338-project Jul 31 18:45:36.637370 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:45:36.637370 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:45:36.637370 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: c7dd082069b3423a8686cd809c8d4110 Jul 31 18:45:36.637370 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-VolumesNegativeTest-1813299338-project Jul 31 18:45:36.637370 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: > Jul 31 18:45:36.637370 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Instance c4dd49d5-fe53-423c-9ced-8f99609865ef could not be found. Jul 31 18:45:36.637370 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'id': 'c4dd49d5-fe53-423c-9ced-8f99609865ef'} Jul 31 18:45:36.638184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:45:36.638184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:45:36.638184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:45:36.638184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:45:36.638184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:45:36.638184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:45:36.638184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:45:36.638184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:45:36.638184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:45:36.638184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:45:36.638184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4dd49d5-fe53-423c-9ced-8f99609865ef could not be found. Jul 31 18:45:36.638184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:45:36.638184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:45:36.638184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:45:36.638184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:45:36.638184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:45:36.638184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:45:36.638184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:45:36.638184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:45:36.638184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:45:36.639443 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:45:36.639443 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:45:36.639443 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:45:36.639443 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:45:36.639443 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:45:36.639443 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:45:36.639443 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:45:36.639443 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4dd49d5-fe53-423c-9ced-8f99609865ef could not be found. Jul 31 18:45:36.639443 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:45:36.639443 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:45:36.639443 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:45:36.639443 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:45:36.639443 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:45:36.639443 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:45:36.639443 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:45:36.639443 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:45:36.639443 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4dd49d5-fe53-423c-9ced-8f99609865ef could not be found. Jul 31 18:45:36.639443 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:45:36.640588 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-54481a68-30df-4adf-b752-746ca13f36e1 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] Returning 404 to user: Instance c4dd49d5-fe53-423c-9ced-8f99609865ef could not be found. {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:45:36.640588 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-54481a68-30df-4adf-b752-746ca13f36e1 tempest-VolumesNegativeTest-1813299338 tempest-VolumesNegativeTest-1813299338-project] 10.222.0.49 "GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef" status: 404 len: 111 microversion: 2.1 time: 0.056879 Jul 31 18:45:36.642013 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 425/830] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:45:36 2022] GET /compute/v2.1/servers/c4dd49d5-fe53-423c-9ced-8f99609865ef => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:45:56.763824 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:45:56.764564 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:45:57.155800 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-8a81cff5-1464-4fa0-a55c-ae013597ade1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Action: 'create', calling method: .version_select at 0x7f8709fa6dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1726321377", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBDQK+GRJ+4XIwMR8dVxrgRu58TN4/zJZEKrbiR+nyXQJzlXmdfz08WB5oHioFt+DsnXghIqtD6968Nkj/FTP725k6b6/PrQTg4tH74qLJKSn1ZzhvPwxFP+U+ZPPI1Gg=="}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:45:57.175857 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-8a81cff5-1464-4fa0-a55c-ae013597ade1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Getting quotas for project 11018257977c4b8ba8f008c0c6ae65fd. Resources: {'key_pairs'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:45:57.191727 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-8a81cff5-1464-4fa0-a55c-ae013597ade1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Getting quotas for user 64d0451d06294c968712f411f90f224e and project 11018257977c4b8ba8f008c0c6ae65fd. Resources: {'key_pairs'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:45:57.220931 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-8a81cff5-1464-4fa0-a55c-ae013597ade1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.463901 Jul 31 18:45:57.229892 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 406/831] 10.222.0.49 () {60 vars in 1159 bytes} [Sun Jul 31 18:45:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:46:00.712239 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-83cd2ca0-640a-4203-8876-e9a5c9c08df4 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Action: 'create', calling method: .version_select at 0x7f8709732550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1684975059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkqUKtIHZQWJ8F9D7mT4SDA34HYP5k8V//J1Op4KyHG/Iw4EiGTeSeIulFLOB4cGlMMvrNAEq3keY6JMFHo4POaXp87+jJPzHXZlbetgAQ4k+50bGp+qxR4ldf2H2oepA=="}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:46:00.727328 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=28 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:46:00.727959 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=56 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:46:00.741089 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.quota [None req-83cd2ca0-640a-4203-8876-e9a5c9c08df4 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Getting quotas for project 897eef74408f4973bfb541b7f92365c7. Resources: {'key_pairs'} {{(pid=124334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:46:00.746831 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.quota [None req-83cd2ca0-640a-4203-8876-e9a5c9c08df4 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Getting quotas for user 08ee7fc8c18641b2ac4c1400638d54f1 and project 897eef74408f4973bfb541b7f92365c7. Resources: {'key_pairs'} {{(pid=124334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:46:00.779697 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-83cd2ca0-640a-4203-8876-e9a5c9c08df4 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.076744 Jul 31 18:46:00.783900 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 426/832] 10.222.0.49 () {60 vars in 1159 bytes} [Sun Jul 31 18:46:00 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:46:00.901970 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-b634ad0a-db4d-49bb-b629-fa8681acf1ff tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-955622675", "imageRef": "f236610b-2d90-4a2d-a02c-f614ff8e49e7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1684975059", "networks": [{"uuid": "ccc07e9a-e940-48a5-9687-b26b5b17ffba"}]}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:46:00.957691 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.network.neutron [None req-b634ad0a-db4d-49bb-b629-fa8681acf1ff tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] validate_networks() for [('ccc07e9a-e940-48a5-9687-b26b5b17ffba', None, None, None, None, None)] {{(pid=124333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 18:46:01.372852 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-b634ad0a-db4d-49bb-b629-fa8681acf1ff tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Flavor limits 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 18:46:01.373265 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-b634ad0a-db4d-49bb-b629-fa8681acf1ff tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Image limits 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 18:46:01.373728 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-b634ad0a-db4d-49bb-b629-fa8681acf1ff tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Flavor pref 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 18:46:01.374124 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-b634ad0a-db4d-49bb-b629-fa8681acf1ff tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Image pref 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 18:46:01.374522 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-b634ad0a-db4d-49bb-b629-fa8681acf1ff tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 18:46:01.384895 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b634ad0a-db4d-49bb-b629-fa8681acf1ff tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:01.385428 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b634ad0a-db4d-49bb-b629-fa8681acf1ff tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:01.386306 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b634ad0a-db4d-49bb-b629-fa8681acf1ff tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:01.386740 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b634ad0a-db4d-49bb-b629-fa8681acf1ff tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:01.408411 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-b634ad0a-db4d-49bb-b629-fa8681acf1ff tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Getting quotas for project 897eef74408f4973bfb541b7f92365c7. Resources: {'cores', 'ram', 'instances'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:46:01.415070 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-b634ad0a-db4d-49bb-b629-fa8681acf1ff tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Getting quotas for user 08ee7fc8c18641b2ac4c1400638d54f1 and project 897eef74408f4973bfb541b7f92365c7. Resources: {'cores', 'ram', 'instances'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:46:01.430403 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-b634ad0a-db4d-49bb-b629-fa8681acf1ff tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Going to run 1 instances... {{(pid=124333) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 18:46:01.432950 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-b634ad0a-db4d-49bb-b629-fa8681acf1ff tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f236610b-2d90-4a2d-a02c-f614ff8e49e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 18:46:01.481946 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-b634ad0a-db4d-49bb-b629-fa8681acf1ff tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583844 Jul 31 18:46:01.482582 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 407/833] 10.222.0.49 () {60 vars in 1147 bytes} [Sun Jul 31 18:46:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 18:46:01.493524 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-2e7bb40e-b706-47c0-b40b-91864e9344d7 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:01.494140 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-2e7bb40e-b706-47c0-b40b-91864e9344d7 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:01.571799 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-2e7bb40e-b706-47c0-b40b-91864e9344d7 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:01.579703 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-2e7bb40e-b706-47c0-b40b-91864e9344d7 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1258 microversion: 2.1 time: 0.090106 Jul 31 18:46:01.584598 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 427/834] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:01 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1258 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:02.600925 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-8fe9ac49-a213-4c0c-a9f9-debdf3b0feb5 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:02.602734 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-8fe9ac49-a213-4c0c-a9f9-debdf3b0feb5 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:02.611557 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8fe9ac49-a213-4c0c-a9f9-debdf3b0feb5 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:02.612172 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8fe9ac49-a213-4c0c-a9f9-debdf3b0feb5 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:02.613371 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8fe9ac49-a213-4c0c-a9f9-debdf3b0feb5 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:02.614074 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8fe9ac49-a213-4c0c-a9f9-debdf3b0feb5 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:02.707197 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-8fe9ac49-a213-4c0c-a9f9-debdf3b0feb5 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:02.717643 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-8fe9ac49-a213-4c0c-a9f9-debdf3b0feb5 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1328 microversion: 2.1 time: 0.121609 Jul 31 18:46:02.718946 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 408/835] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:02 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1328 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:46:03.740956 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-3fffb9d9-e912-4f71-8ef5-fabfa42aec84 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:03.741867 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-3fffb9d9-e912-4f71-8ef5-fabfa42aec84 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:03.766021 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3fffb9d9-e912-4f71-8ef5-fabfa42aec84 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:03.767288 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3fffb9d9-e912-4f71-8ef5-fabfa42aec84 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:03.769690 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3fffb9d9-e912-4f71-8ef5-fabfa42aec84 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:03.771746 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3fffb9d9-e912-4f71-8ef5-fabfa42aec84 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:04.003803 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-3fffb9d9-e912-4f71-8ef5-fabfa42aec84 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:04.013574 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-3fffb9d9-e912-4f71-8ef5-fabfa42aec84 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1358 microversion: 2.1 time: 0.278382 Jul 31 18:46:04.015059 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 428/836] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:03 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1358 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:05.036567 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-e7bab534-eccc-4c62-b67a-a12473e41561 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:05.037247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-e7bab534-eccc-4c62-b67a-a12473e41561 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:05.056328 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e7bab534-eccc-4c62-b67a-a12473e41561 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:05.057467 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e7bab534-eccc-4c62-b67a-a12473e41561 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:05.058512 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e7bab534-eccc-4c62-b67a-a12473e41561 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:05.058983 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-e7bab534-eccc-4c62-b67a-a12473e41561 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:05.209612 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-e7bab534-eccc-4c62-b67a-a12473e41561 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:05.217127 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-e7bab534-eccc-4c62-b67a-a12473e41561 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1358 microversion: 2.1 time: 0.185441 Jul 31 18:46:05.217680 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 409/837] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:05 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:46:06.238533 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-65903738-ea13-43d2-8662-416b190cc31f tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:06.239944 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-65903738-ea13-43d2-8662-416b190cc31f tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:06.248001 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-65903738-ea13-43d2-8662-416b190cc31f tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:06.248595 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-65903738-ea13-43d2-8662-416b190cc31f tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:06.249475 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-65903738-ea13-43d2-8662-416b190cc31f tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:06.250149 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-65903738-ea13-43d2-8662-416b190cc31f tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:06.403461 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-65903738-ea13-43d2-8662-416b190cc31f tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:06.415522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-65903738-ea13-43d2-8662-416b190cc31f tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1358 microversion: 2.1 time: 0.180953 Jul 31 18:46:06.416132 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 429/838] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:06 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:07.439932 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-ff9edb38-0628-4a59-a83b-ff708c80a87e tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:07.440517 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-ff9edb38-0628-4a59-a83b-ff708c80a87e tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:07.447342 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ff9edb38-0628-4a59-a83b-ff708c80a87e tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:07.447777 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ff9edb38-0628-4a59-a83b-ff708c80a87e tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:07.448526 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ff9edb38-0628-4a59-a83b-ff708c80a87e tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:07.448989 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ff9edb38-0628-4a59-a83b-ff708c80a87e tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:07.604313 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-ff9edb38-0628-4a59-a83b-ff708c80a87e tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:07.612699 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-ff9edb38-0628-4a59-a83b-ff708c80a87e tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1358 microversion: 2.1 time: 0.176753 Jul 31 18:46:07.613310 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 410/839] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:07 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:08.634614 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-229150cf-52cc-4d41-90e0-9a05456ebf64 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:08.635281 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-229150cf-52cc-4d41-90e0-9a05456ebf64 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:08.642014 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-229150cf-52cc-4d41-90e0-9a05456ebf64 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:08.642465 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-229150cf-52cc-4d41-90e0-9a05456ebf64 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:08.643242 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-229150cf-52cc-4d41-90e0-9a05456ebf64 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:08.643668 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-229150cf-52cc-4d41-90e0-9a05456ebf64 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:08.802783 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-229150cf-52cc-4d41-90e0-9a05456ebf64 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:08.812732 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-229150cf-52cc-4d41-90e0-9a05456ebf64 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1358 microversion: 2.1 time: 0.182053 Jul 31 18:46:08.813566 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 430/840] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:08 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:09.839278 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-5f9ca460-bad0-4648-aa07-dda9bd9cbd7b tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:09.840379 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-5f9ca460-bad0-4648-aa07-dda9bd9cbd7b tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:09.877388 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5f9ca460-bad0-4648-aa07-dda9bd9cbd7b tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:09.878874 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5f9ca460-bad0-4648-aa07-dda9bd9cbd7b tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:09.882358 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5f9ca460-bad0-4648-aa07-dda9bd9cbd7b tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:09.889981 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5f9ca460-bad0-4648-aa07-dda9bd9cbd7b tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:10.086213 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-5f9ca460-bad0-4648-aa07-dda9bd9cbd7b tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:10.093965 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-5f9ca460-bad0-4648-aa07-dda9bd9cbd7b tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1358 microversion: 2.1 time: 0.261253 Jul 31 18:46:10.101113 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 411/841] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:09 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1358 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:11.115492 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-56d324a4-5d61-4ffe-bdfa-af40d978220c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:11.116099 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-56d324a4-5d61-4ffe-bdfa-af40d978220c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:11.123399 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-56d324a4-5d61-4ffe-bdfa-af40d978220c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:11.123847 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-56d324a4-5d61-4ffe-bdfa-af40d978220c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:11.124619 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-56d324a4-5d61-4ffe-bdfa-af40d978220c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:11.125086 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-56d324a4-5d61-4ffe-bdfa-af40d978220c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:11.266539 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-56d324a4-5d61-4ffe-bdfa-af40d978220c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:11.278385 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-56d324a4-5d61-4ffe-bdfa-af40d978220c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1358 microversion: 2.1 time: 0.166821 Jul 31 18:46:11.279212 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 431/842] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:11 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:12.221398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-7c221d86-4f04-4b7c-9282-7c2d8b311a7c req-9568c7ed-c034-4c57-ae9e-e1ef1b93541e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36f18e8e-5304-472a-90f9-7cb6c366c09a", "tag": "b166905f-43cd-4072-a1dd-8c1e432d4400"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:46:12.228344 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell0:SELECT=2 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:46:12.230088 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell0:SELECT=10 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:46:12.237630 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-7c221d86-4f04-4b7c-9282-7c2d8b311a7c req-9568c7ed-c034-4c57-ae9e-e1ef1b93541e service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:12.238152 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-7c221d86-4f04-4b7c-9282-7c2d8b311a7c req-9568c7ed-c034-4c57-ae9e-e1ef1b93541e service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:12.250395 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-7c221d86-4f04-4b7c-9282-7c2d8b311a7c req-9568c7ed-c034-4c57-ae9e-e1ef1b93541e service nova] Creating event network-changed:b166905f-43cd-4072-a1dd-8c1e432d4400 for instance 36f18e8e-5304-472a-90f9-7cb6c366c09a on hv-cinder-84984 Jul 31 18:46:12.255963 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-7c221d86-4f04-4b7c-9282-7c2d8b311a7c req-9568c7ed-c034-4c57-ae9e-e1ef1b93541e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039416 Jul 31 18:46:12.256679 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 412/843] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:46:12.299402 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-ad311811-6d10-4af0-b0e8-bf654eed1e74 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:12.300088 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-ad311811-6d10-4af0-b0e8-bf654eed1e74 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:12.302209 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell0:SELECT=6 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:46:12.309396 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ad311811-6d10-4af0-b0e8-bf654eed1e74 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:12.309855 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ad311811-6d10-4af0-b0e8-bf654eed1e74 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:12.310620 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ad311811-6d10-4af0-b0e8-bf654eed1e74 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:12.311236 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ad311811-6d10-4af0-b0e8-bf654eed1e74 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:12.447355 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-ad311811-6d10-4af0-b0e8-bf654eed1e74 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:12.455221 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-ad311811-6d10-4af0-b0e8-bf654eed1e74 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1358 microversion: 2.1 time: 0.159829 Jul 31 18:46:12.455795 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 432/844] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:12 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:13.476660 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-2812cfa2-df59-4e98-9838-9709ec3c15a4 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:13.477469 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-2812cfa2-df59-4e98-9838-9709ec3c15a4 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:13.486493 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2812cfa2-df59-4e98-9838-9709ec3c15a4 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:13.487154 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2812cfa2-df59-4e98-9838-9709ec3c15a4 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:13.488358 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2812cfa2-df59-4e98-9838-9709ec3c15a4 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:13.489096 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2812cfa2-df59-4e98-9838-9709ec3c15a4 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:13.683035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-2812cfa2-df59-4e98-9838-9709ec3c15a4 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:13.690977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-2812cfa2-df59-4e98-9838-9709ec3c15a4 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1358 microversion: 2.1 time: 0.219013 Jul 31 18:46:13.691551 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 413/845] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:13 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:14.340736 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-ff39e34e-8159-483e-bcca-e874abd47e26 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1494567661", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1726321377", "security_groups": [{"name": "tempest-secgroup-smoke-1256128819"}], "block_device_mapping_v2": [{"uuid": "1e90b877-e53a-40d9-9cdf-14ba5222b16e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f19c9398-32c7-4fbb-be0b-42ad6f2a09f6"}]}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:46:14.459542 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.network.neutron [None req-ff39e34e-8159-483e-bcca-e874abd47e26 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] validate_networks() for [('f19c9398-32c7-4fbb-be0b-42ad6f2a09f6', None, None, None, None, None)] {{(pid=124334) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 18:46:14.711967 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-30aff8c8-c81a-4bf4-bbba-293e111a470c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:14.712569 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-30aff8c8-c81a-4bf4-bbba-293e111a470c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:14.719494 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-30aff8c8-c81a-4bf4-bbba-293e111a470c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:14.719894 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-30aff8c8-c81a-4bf4-bbba-293e111a470c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:14.720683 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-30aff8c8-c81a-4bf4-bbba-293e111a470c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:14.721142 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-30aff8c8-c81a-4bf4-bbba-293e111a470c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:14.846480 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-ff39e34e-8159-483e-bcca-e874abd47e26 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Flavor limits 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 18:46:14.846914 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-ff39e34e-8159-483e-bcca-e874abd47e26 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Image limits 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 18:46:14.847387 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-ff39e34e-8159-483e-bcca-e874abd47e26 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Flavor pref 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 18:46:14.847796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-ff39e34e-8159-483e-bcca-e874abd47e26 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Image pref 0:0:0 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 18:46:14.848205 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.virt.hardware [None req-ff39e34e-8159-483e-bcca-e874abd47e26 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 18:46:14.855801 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-30aff8c8-c81a-4bf4-bbba-293e111a470c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:14.857602 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ff39e34e-8159-483e-bcca-e874abd47e26 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:14.858053 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ff39e34e-8159-483e-bcca-e874abd47e26 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:14.858852 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ff39e34e-8159-483e-bcca-e874abd47e26 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:14.859288 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ff39e34e-8159-483e-bcca-e874abd47e26 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:14.863165 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-30aff8c8-c81a-4bf4-bbba-293e111a470c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1358 microversion: 2.1 time: 0.155377 Jul 31 18:46:14.863893 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 414/846] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:14 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:14.876172 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.quota [None req-ff39e34e-8159-483e-bcca-e874abd47e26 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Getting quotas for project 11018257977c4b8ba8f008c0c6ae65fd. Resources: {'cores', 'ram', 'instances'} {{(pid=124334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:46:14.880537 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.quota [None req-ff39e34e-8159-483e-bcca-e874abd47e26 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Getting quotas for user 64d0451d06294c968712f411f90f224e and project 11018257977c4b8ba8f008c0c6ae65fd. Resources: {'cores', 'ram', 'instances'} {{(pid=124334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:46:14.935799 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-ff39e34e-8159-483e-bcca-e874abd47e26 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Going to run 1 instances... {{(pid=124334) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 18:46:14.937946 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-ff39e34e-8159-483e-bcca-e874abd47e26 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: b660fdbd-8dc6-4ed3-81b3-73121c89761a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1e90b877-e53a-40d9-9cdf-14ba5222b16e',volume_size=None,volume_type=None)] {{(pid=124334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 18:46:15.077883 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-ff39e34e-8159-483e-bcca-e874abd47e26 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.741010 Jul 31 18:46:15.078526 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 433/847] 10.222.0.49 () {60 vars in 1147 bytes} [Sun Jul 31 18:46:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 18:46:15.089544 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-fc72c60c-f105-493b-a5c6-cb732e507d89 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:15.090123 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-fc72c60c-f105-493b-a5c6-cb732e507d89 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: b660fdbd-8dc6-4ed3-81b3-73121c89761a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:15.145895 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-fc72c60c-f105-493b-a5c6-cb732e507d89 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:15.152493 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-fc72c60c-f105-493b-a5c6-cb732e507d89 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a" status: 200 len: 1095 microversion: 2.1 time: 0.066755 Jul 31 18:46:15.153025 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 415/848] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:15 2022] GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:15.888849 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-923709fb-281b-4b68-b739-615eecd055c8 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:15.889841 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-923709fb-281b-4b68-b739-615eecd055c8 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:15.902379 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-923709fb-281b-4b68-b739-615eecd055c8 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:15.903179 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-923709fb-281b-4b68-b739-615eecd055c8 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:15.904433 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-923709fb-281b-4b68-b739-615eecd055c8 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:15.905206 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-923709fb-281b-4b68-b739-615eecd055c8 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:16.036023 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-923709fb-281b-4b68-b739-615eecd055c8 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:16.046138 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-923709fb-281b-4b68-b739-615eecd055c8 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1358 microversion: 2.1 time: 0.163852 Jul 31 18:46:16.046815 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 434/849] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:15 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:16.179183 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-d6564915-51a1-429c-a6e8-ec150ce06b8a tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:16.180465 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-d6564915-51a1-429c-a6e8-ec150ce06b8a tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: b660fdbd-8dc6-4ed3-81b3-73121c89761a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:16.187726 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d6564915-51a1-429c-a6e8-ec150ce06b8a tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:16.188699 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d6564915-51a1-429c-a6e8-ec150ce06b8a tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:16.189756 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d6564915-51a1-429c-a6e8-ec150ce06b8a tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:16.190398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d6564915-51a1-429c-a6e8-ec150ce06b8a tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:16.298999 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-d6564915-51a1-429c-a6e8-ec150ce06b8a tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:16.309322 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-d6564915-51a1-429c-a6e8-ec150ce06b8a tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a" status: 200 len: 1211 microversion: 2.1 time: 0.134044 Jul 31 18:46:16.310935 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 416/850] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:16 2022] GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a => generated 1211 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:17.069827 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-622a6a31-939a-4887-ad2b-809ca13a69e8 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:17.070485 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-622a6a31-939a-4887-ad2b-809ca13a69e8 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:17.078167 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-622a6a31-939a-4887-ad2b-809ca13a69e8 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:17.078665 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-622a6a31-939a-4887-ad2b-809ca13a69e8 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:17.079858 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-622a6a31-939a-4887-ad2b-809ca13a69e8 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:17.080343 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-622a6a31-939a-4887-ad2b-809ca13a69e8 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:17.214752 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-622a6a31-939a-4887-ad2b-809ca13a69e8 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:17.222987 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-622a6a31-939a-4887-ad2b-809ca13a69e8 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1358 microversion: 2.1 time: 0.157184 Jul 31 18:46:17.224240 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 435/851] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:17 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:17.331014 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-9d381f12-a139-4b9b-a50b-5f7c711a94d1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:17.331527 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-9d381f12-a139-4b9b-a50b-5f7c711a94d1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: b660fdbd-8dc6-4ed3-81b3-73121c89761a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:17.338461 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9d381f12-a139-4b9b-a50b-5f7c711a94d1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:17.338906 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9d381f12-a139-4b9b-a50b-5f7c711a94d1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:17.339674 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9d381f12-a139-4b9b-a50b-5f7c711a94d1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:17.340093 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9d381f12-a139-4b9b-a50b-5f7c711a94d1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:17.479139 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-34cd3e49-38d5-41bf-aab9-2897ad54a6a3 req-71f507c4-c448-44e4-a82d-e720941b4fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b660fdbd-8dc6-4ed3-81b3-73121c89761a", "tag": "ebad17d0-21ab-499a-8323-58c8f38938ef"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:46:17.491418 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-34cd3e49-38d5-41bf-aab9-2897ad54a6a3 req-71f507c4-c448-44e4-a82d-e720941b4fd4 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:17.491841 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-34cd3e49-38d5-41bf-aab9-2897ad54a6a3 req-71f507c4-c448-44e4-a82d-e720941b4fd4 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:17.505167 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-34cd3e49-38d5-41bf-aab9-2897ad54a6a3 req-71f507c4-c448-44e4-a82d-e720941b4fd4 service nova] Creating event network-changed:ebad17d0-21ab-499a-8323-58c8f38938ef for instance b660fdbd-8dc6-4ed3-81b3-73121c89761a on hv-cinder-84984 Jul 31 18:46:17.510500 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-34cd3e49-38d5-41bf-aab9-2897ad54a6a3 req-71f507c4-c448-44e4-a82d-e720941b4fd4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035101 Jul 31 18:46:17.511168 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 436/852] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:46:17.571862 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-9d381f12-a139-4b9b-a50b-5f7c711a94d1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:17.580568 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-9d381f12-a139-4b9b-a50b-5f7c711a94d1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a" status: 200 len: 1267 microversion: 2.1 time: 0.252859 Jul 31 18:46:17.581820 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 417/853] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:17 2022] GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a => generated 1267 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:18.245776 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-4ce648c4-3aa0-49d6-a746-b14fdce24c66 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:18.246472 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-4ce648c4-3aa0-49d6-a746-b14fdce24c66 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:18.254580 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4ce648c4-3aa0-49d6-a746-b14fdce24c66 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:18.255124 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4ce648c4-3aa0-49d6-a746-b14fdce24c66 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:18.256080 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4ce648c4-3aa0-49d6-a746-b14fdce24c66 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:18.256869 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-4ce648c4-3aa0-49d6-a746-b14fdce24c66 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:18.276446 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-b2ad51e7-6a86-47eb-af45-d9073ca3fd5a req-173006b1-9f0f-431d-b095-5cbe16836231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f18e8e-5304-472a-90f9-7cb6c366c09a", "name": "network-vif-plugged", "status": "completed", "tag": "b166905f-43cd-4072-a1dd-8c1e432d4400"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:46:18.296137 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-b2ad51e7-6a86-47eb-af45-d9073ca3fd5a req-173006b1-9f0f-431d-b095-5cbe16836231 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:18.296617 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-b2ad51e7-6a86-47eb-af45-d9073ca3fd5a req-173006b1-9f0f-431d-b095-5cbe16836231 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:18.310900 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-b2ad51e7-6a86-47eb-af45-d9073ca3fd5a req-173006b1-9f0f-431d-b095-5cbe16836231 service nova] Creating event network-vif-plugged:b166905f-43cd-4072-a1dd-8c1e432d4400 for instance 36f18e8e-5304-472a-90f9-7cb6c366c09a on hv-cinder-84984 Jul 31 18:46:18.317240 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-b2ad51e7-6a86-47eb-af45-d9073ca3fd5a req-173006b1-9f0f-431d-b095-5cbe16836231 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044292 Jul 31 18:46:18.328025 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 418/854] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:46:18.433618 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-4ce648c4-3aa0-49d6-a746-b14fdce24c66 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:18.442392 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-4ce648c4-3aa0-49d6-a746-b14fdce24c66 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1358 microversion: 2.1 time: 0.200722 Jul 31 18:46:18.443012 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 437/855] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:18 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:18.602866 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-de77ca00-6eb6-417b-8d06-25c79990a6f1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:18.603808 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-de77ca00-6eb6-417b-8d06-25c79990a6f1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: b660fdbd-8dc6-4ed3-81b3-73121c89761a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:18.610386 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-de77ca00-6eb6-417b-8d06-25c79990a6f1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:18.610825 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-de77ca00-6eb6-417b-8d06-25c79990a6f1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:18.611581 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-de77ca00-6eb6-417b-8d06-25c79990a6f1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:18.612022 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-de77ca00-6eb6-417b-8d06-25c79990a6f1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:18.801809 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-de77ca00-6eb6-417b-8d06-25c79990a6f1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:18.809863 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-de77ca00-6eb6-417b-8d06-25c79990a6f1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a" status: 200 len: 1267 microversion: 2.1 time: 0.211738 Jul 31 18:46:18.810430 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 419/856] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:18 2022] GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:19.464488 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f3f6eb34-3a1a-417b-9218-614bde78c2f0 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:19.465122 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-f3f6eb34-3a1a-417b-9218-614bde78c2f0 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:19.471943 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f3f6eb34-3a1a-417b-9218-614bde78c2f0 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:19.472383 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f3f6eb34-3a1a-417b-9218-614bde78c2f0 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:19.473166 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f3f6eb34-3a1a-417b-9218-614bde78c2f0 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:19.473589 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f3f6eb34-3a1a-417b-9218-614bde78c2f0 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:19.604695 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-f3f6eb34-3a1a-417b-9218-614bde78c2f0 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:19.617409 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-f3f6eb34-3a1a-417b-9218-614bde78c2f0 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1358 microversion: 2.1 time: 0.156868 Jul 31 18:46:19.618554 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 438/857] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:19 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:46:19.834871 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-012edf0d-817c-4290-9c5d-8f2d32768fa0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:19.835485 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-012edf0d-817c-4290-9c5d-8f2d32768fa0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: b660fdbd-8dc6-4ed3-81b3-73121c89761a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:19.842441 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-012edf0d-817c-4290-9c5d-8f2d32768fa0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:19.842891 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-012edf0d-817c-4290-9c5d-8f2d32768fa0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:19.843651 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-012edf0d-817c-4290-9c5d-8f2d32768fa0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:19.844082 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-012edf0d-817c-4290-9c5d-8f2d32768fa0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:19.975674 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-012edf0d-817c-4290-9c5d-8f2d32768fa0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:19.986862 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-012edf0d-817c-4290-9c5d-8f2d32768fa0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a" status: 200 len: 1267 microversion: 2.1 time: 0.158087 Jul 31 18:46:19.987585 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 420/858] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:19 2022] GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:20.647927 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-6db72a7e-fba3-439e-9c1c-462a6105557b tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:20.648564 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-6db72a7e-fba3-439e-9c1c-462a6105557b tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:20.655638 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6db72a7e-fba3-439e-9c1c-462a6105557b tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:20.656075 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6db72a7e-fba3-439e-9c1c-462a6105557b tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:20.656863 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6db72a7e-fba3-439e-9c1c-462a6105557b tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:20.657289 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6db72a7e-fba3-439e-9c1c-462a6105557b tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:20.789018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-6db72a7e-fba3-439e-9c1c-462a6105557b tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:20.797672 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-6db72a7e-fba3-439e-9c1c-462a6105557b tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1548 microversion: 2.1 time: 0.153747 Jul 31 18:46:20.798713 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 439/859] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:20 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:20.818351 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-33adb103-79aa-4c70-be9f-d4162e650dcf tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:20.818952 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-33adb103-79aa-4c70-be9f-d4162e650dcf tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:20.824996 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-33adb103-79aa-4c70-be9f-d4162e650dcf tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:20.825422 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-33adb103-79aa-4c70-be9f-d4162e650dcf tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:20.826177 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-33adb103-79aa-4c70-be9f-d4162e650dcf tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:20.826598 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-33adb103-79aa-4c70-be9f-d4162e650dcf tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:21.008796 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-922cd05a-d986-4996-a4e1-8bfe2da61412 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:21.009562 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-922cd05a-d986-4996-a4e1-8bfe2da61412 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: b660fdbd-8dc6-4ed3-81b3-73121c89761a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:21.016000 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-922cd05a-d986-4996-a4e1-8bfe2da61412 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:21.016595 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-922cd05a-d986-4996-a4e1-8bfe2da61412 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:21.017389 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-922cd05a-d986-4996-a4e1-8bfe2da61412 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:21.017876 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-922cd05a-d986-4996-a4e1-8bfe2da61412 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:21.029092 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-33adb103-79aa-4c70-be9f-d4162e650dcf tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:21.037681 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-33adb103-79aa-4c70-be9f-d4162e650dcf tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1548 microversion: 2.1 time: 0.223062 Jul 31 18:46:21.039733 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 421/860] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:20 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1548 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:21.059209 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-faea4df7-9742-4f09-9962-686b7387ca57 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:21.064073 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-faea4df7-9742-4f09-9962-686b7387ca57 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:21.065031 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-faea4df7-9742-4f09-9962-686b7387ca57 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Searching by: {'deleted': False, 'project_id': '897eef74408f4973bfb541b7f92365c7'} {{(pid=124333) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 18:46:21.071997 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-faea4df7-9742-4f09-9962-686b7387ca57 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:21.072423 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-faea4df7-9742-4f09-9962-686b7387ca57 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:21.073451 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-faea4df7-9742-4f09-9962-686b7387ca57 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:21.073892 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-faea4df7-9742-4f09-9962-686b7387ca57 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:21.154706 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-922cd05a-d986-4996-a4e1-8bfe2da61412 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:21.162481 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-922cd05a-d986-4996-a4e1-8bfe2da61412 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a" status: 200 len: 1267 microversion: 2.1 time: 0.157699 Jul 31 18:46:21.163050 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 440/861] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:21 2022] GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:21.167133 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.multi_cell_list [None req-faea4df7-9742-4f09-9962-686b7387ca57 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124333) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 18:46:21.259098 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-faea4df7-9742-4f09-9962-686b7387ca57 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.203692 Jul 31 18:46:21.259689 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 422/862] 10.222.0.49 () {58 vars in 1125 bytes} [Sun Jul 31 18:46:21 2022] GET /compute/v2.1/servers => generated 342 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:46:21.271179 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f1ddbb5f-61a3-4fac-9218-eed11423a6e3 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:21.271799 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-f1ddbb5f-61a3-4fac-9218-eed11423a6e3 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:21.278063 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f1ddbb5f-61a3-4fac-9218-eed11423a6e3 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:21.278513 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f1ddbb5f-61a3-4fac-9218-eed11423a6e3 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:21.279280 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f1ddbb5f-61a3-4fac-9218-eed11423a6e3 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:21.279714 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f1ddbb5f-61a3-4fac-9218-eed11423a6e3 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:21.413569 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-f1ddbb5f-61a3-4fac-9218-eed11423a6e3 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:21.421361 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-f1ddbb5f-61a3-4fac-9218-eed11423a6e3 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1548 microversion: 2.1 time: 0.154099 Jul 31 18:46:21.421929 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 441/863] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:21 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:22.187354 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-b0b94fe9-1296-4515-83c6-0f451a864414 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:22.188278 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-b0b94fe9-1296-4515-83c6-0f451a864414 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: b660fdbd-8dc6-4ed3-81b3-73121c89761a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:22.199228 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b0b94fe9-1296-4515-83c6-0f451a864414 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:22.199958 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b0b94fe9-1296-4515-83c6-0f451a864414 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:22.201251 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b0b94fe9-1296-4515-83c6-0f451a864414 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:22.201960 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b0b94fe9-1296-4515-83c6-0f451a864414 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:22.334651 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-b0b94fe9-1296-4515-83c6-0f451a864414 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:22.342199 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-b0b94fe9-1296-4515-83c6-0f451a864414 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a" status: 200 len: 1267 microversion: 2.1 time: 0.161499 Jul 31 18:46:22.342754 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 423/864] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:22 2022] GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:22.976624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-727e9d65-b960-49bc-9424-97f72a0a23cd tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b01e269a-a446-4919-9047-78d1a83d8c22"}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:46:22.979093 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-727e9d65-b960-49bc-9424-97f72a0a23cd tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:22.985975 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-727e9d65-b960-49bc-9424-97f72a0a23cd tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:22.986417 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-727e9d65-b960-49bc-9424-97f72a0a23cd tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:22.987172 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-727e9d65-b960-49bc-9424-97f72a0a23cd tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:22.987628 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-727e9d65-b960-49bc-9424-97f72a0a23cd tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:23.248441 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-727e9d65-b960-49bc-9424-97f72a0a23cd tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "POST /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276022 Jul 31 18:46:23.253823 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 442/865] 10.222.0.49 () {60 vars in 1323 bytes} [Sun Jul 31 18:46:22 2022] POST /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:46:23.366381 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-9701b9a3-be00-4168-bcd3-cf19b2e3f524 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:23.367265 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-9701b9a3-be00-4168-bcd3-cf19b2e3f524 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: b660fdbd-8dc6-4ed3-81b3-73121c89761a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:23.377889 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9701b9a3-be00-4168-bcd3-cf19b2e3f524 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:23.378560 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9701b9a3-be00-4168-bcd3-cf19b2e3f524 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:23.379715 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9701b9a3-be00-4168-bcd3-cf19b2e3f524 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:23.380508 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9701b9a3-be00-4168-bcd3-cf19b2e3f524 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:23.684390 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-9701b9a3-be00-4168-bcd3-cf19b2e3f524 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:23.695663 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-9701b9a3-be00-4168-bcd3-cf19b2e3f524 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a" status: 200 len: 1267 microversion: 2.1 time: 0.335188 Jul 31 18:46:23.696347 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 424/866] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:23 2022] GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a => generated 1267 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:24.723680 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-3b383a58-a250-44d3-876b-4af1ed2a2734 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:24.724826 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-3b383a58-a250-44d3-876b-4af1ed2a2734 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: b660fdbd-8dc6-4ed3-81b3-73121c89761a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:24.733712 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3b383a58-a250-44d3-876b-4af1ed2a2734 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:24.734162 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3b383a58-a250-44d3-876b-4af1ed2a2734 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:24.734918 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3b383a58-a250-44d3-876b-4af1ed2a2734 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:24.735356 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3b383a58-a250-44d3-876b-4af1ed2a2734 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:24.868015 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-3b383a58-a250-44d3-876b-4af1ed2a2734 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:24.871477 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell0:SELECT=2 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:46:24.881430 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-3b383a58-a250-44d3-876b-4af1ed2a2734 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a" status: 200 len: 1267 microversion: 2.1 time: 0.166402 Jul 31 18:46:24.882008 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 443/867] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:24 2022] GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:25.903487 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-da5f8d3b-5974-4f0d-be4d-6dfb65816cc9 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:25.904113 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-da5f8d3b-5974-4f0d-be4d-6dfb65816cc9 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: b660fdbd-8dc6-4ed3-81b3-73121c89761a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:25.906592 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell0:SELECT=2 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:46:25.912446 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-da5f8d3b-5974-4f0d-be4d-6dfb65816cc9 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:25.912931 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-da5f8d3b-5974-4f0d-be4d-6dfb65816cc9 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:25.913692 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-da5f8d3b-5974-4f0d-be4d-6dfb65816cc9 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:25.914111 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-da5f8d3b-5974-4f0d-be4d-6dfb65816cc9 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:26.062013 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-da5f8d3b-5974-4f0d-be4d-6dfb65816cc9 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:26.069695 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-da5f8d3b-5974-4f0d-be4d-6dfb65816cc9 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a" status: 200 len: 1267 microversion: 2.1 time: 0.170443 Jul 31 18:46:26.070225 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 425/868] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:25 2022] GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:27.095124 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-cc6ac9b2-3c1e-4a73-8ab0-b23c1d222e8f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:27.096142 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-cc6ac9b2-3c1e-4a73-8ab0-b23c1d222e8f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: b660fdbd-8dc6-4ed3-81b3-73121c89761a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:27.098945 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell0:SELECT=6 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:46:27.107074 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cc6ac9b2-3c1e-4a73-8ab0-b23c1d222e8f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:27.107514 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cc6ac9b2-3c1e-4a73-8ab0-b23c1d222e8f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:27.108267 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cc6ac9b2-3c1e-4a73-8ab0-b23c1d222e8f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:27.108696 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cc6ac9b2-3c1e-4a73-8ab0-b23c1d222e8f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:27.127222 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:46:27.253697 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-cc6ac9b2-3c1e-4a73-8ab0-b23c1d222e8f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:27.261646 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-cc6ac9b2-3c1e-4a73-8ab0-b23c1d222e8f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a" status: 200 len: 1267 microversion: 2.1 time: 0.173509 Jul 31 18:46:27.262203 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 444/869] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:27 2022] GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:28.282975 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-9f512362-f93e-4ed2-8a71-d20e4b1ef6ca tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:28.283597 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-9f512362-f93e-4ed2-8a71-d20e4b1ef6ca tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: b660fdbd-8dc6-4ed3-81b3-73121c89761a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:28.285957 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:46:28.292533 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9f512362-f93e-4ed2-8a71-d20e4b1ef6ca tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:28.293006 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9f512362-f93e-4ed2-8a71-d20e4b1ef6ca tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:28.293783 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9f512362-f93e-4ed2-8a71-d20e4b1ef6ca tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:28.294205 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9f512362-f93e-4ed2-8a71-d20e4b1ef6ca tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:28.297748 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=99 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:46:28.363068 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-e3f3488e-91e3-469c-b977-970f094661c1 req-652e13de-2a43-48ad-afea-f2f321442e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b660fdbd-8dc6-4ed3-81b3-73121c89761a", "name": "network-vif-plugged", "status": "completed", "tag": "ebad17d0-21ab-499a-8323-58c8f38938ef"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:46:28.374637 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-e3f3488e-91e3-469c-b977-970f094661c1 req-652e13de-2a43-48ad-afea-f2f321442e3e service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:28.375933 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-e3f3488e-91e3-469c-b977-970f094661c1 req-652e13de-2a43-48ad-afea-f2f321442e3e service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:28.388075 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-e3f3488e-91e3-469c-b977-970f094661c1 req-652e13de-2a43-48ad-afea-f2f321442e3e service nova] Creating event network-vif-plugged:ebad17d0-21ab-499a-8323-58c8f38938ef for instance b660fdbd-8dc6-4ed3-81b3-73121c89761a on hv-cinder-84984 Jul 31 18:46:28.393151 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-e3f3488e-91e3-469c-b977-970f094661c1 req-652e13de-2a43-48ad-afea-f2f321442e3e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033841 Jul 31 18:46:28.393886 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 445/870] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:46:28.432862 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-9f512362-f93e-4ed2-8a71-d20e4b1ef6ca tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:28.440572 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-9f512362-f93e-4ed2-8a71-d20e4b1ef6ca tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a" status: 200 len: 1267 microversion: 2.1 time: 0.161639 Jul 31 18:46:28.441165 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 426/871] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:28 2022] GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:29.462724 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-18c10de7-43f8-44ee-b686-3b8ca02ff6ba tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:29.463393 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-18c10de7-43f8-44ee-b686-3b8ca02ff6ba tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: b660fdbd-8dc6-4ed3-81b3-73121c89761a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:29.469990 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-18c10de7-43f8-44ee-b686-3b8ca02ff6ba tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:29.470438 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-18c10de7-43f8-44ee-b686-3b8ca02ff6ba tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:29.471197 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-18c10de7-43f8-44ee-b686-3b8ca02ff6ba tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:29.471624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-18c10de7-43f8-44ee-b686-3b8ca02ff6ba tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:29.614141 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-18c10de7-43f8-44ee-b686-3b8ca02ff6ba tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:29.622088 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-18c10de7-43f8-44ee-b686-3b8ca02ff6ba tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a" status: 200 len: 1267 microversion: 2.1 time: 0.164148 Jul 31 18:46:29.622656 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 446/872] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:29 2022] GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:30.644517 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-324868ba-abc7-4a3f-a5ca-649a437f8f5c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:30.645358 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-324868ba-abc7-4a3f-a5ca-649a437f8f5c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: b660fdbd-8dc6-4ed3-81b3-73121c89761a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:30.653671 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-324868ba-abc7-4a3f-a5ca-649a437f8f5c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:30.654107 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-324868ba-abc7-4a3f-a5ca-649a437f8f5c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:30.654924 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-324868ba-abc7-4a3f-a5ca-649a437f8f5c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:30.655396 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-324868ba-abc7-4a3f-a5ca-649a437f8f5c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:30.793901 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-324868ba-abc7-4a3f-a5ca-649a437f8f5c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:30.801601 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-324868ba-abc7-4a3f-a5ca-649a437f8f5c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a" status: 200 len: 1454 microversion: 2.1 time: 0.162203 Jul 31 18:46:30.802104 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 427/873] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:30 2022] GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:30.821245 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-b42748dc-bd23-436f-8c24-1d1d7cbc175b tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:30.821957 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-b42748dc-bd23-436f-8c24-1d1d7cbc175b tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: b660fdbd-8dc6-4ed3-81b3-73121c89761a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:30.824571 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:46:30.830099 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b42748dc-bd23-436f-8c24-1d1d7cbc175b tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:30.830603 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b42748dc-bd23-436f-8c24-1d1d7cbc175b tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:30.831438 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b42748dc-bd23-436f-8c24-1d1d7cbc175b tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:30.831930 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-b42748dc-bd23-436f-8c24-1d1d7cbc175b tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:30.863940 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-c33f449e-470e-42ed-ba17-a3403b19e5be tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:30.864570 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-c33f449e-470e-42ed-ba17-a3403b19e5be tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:30.870702 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c33f449e-470e-42ed-ba17-a3403b19e5be tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:30.871139 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c33f449e-470e-42ed-ba17-a3403b19e5be tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:30.871897 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c33f449e-470e-42ed-ba17-a3403b19e5be tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:30.872328 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-c33f449e-470e-42ed-ba17-a3403b19e5be tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:30.971243 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-b42748dc-bd23-436f-8c24-1d1d7cbc175b tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:30.978993 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-b42748dc-bd23-436f-8c24-1d1d7cbc175b tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a" status: 200 len: 1454 microversion: 2.1 time: 0.161562 Jul 31 18:46:30.979555 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 447/874] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:30 2022] GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:31.005196 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-c33f449e-470e-42ed-ba17-a3403b19e5be tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:31.013417 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-c33f449e-470e-42ed-ba17-a3403b19e5be tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1594 microversion: 2.1 time: 0.153388 Jul 31 18:46:31.013974 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 428/875] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:30 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:46:32.869987 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-5f3a0f2b-7170-4bfd-80b3-f9fc7458f4e7 req-be372c1f-10c6-44dd-a495-eadc77f4ca90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b660fdbd-8dc6-4ed3-81b3-73121c89761a", "tag": "ebad17d0-21ab-499a-8323-58c8f38938ef"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:46:32.882095 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-5f3a0f2b-7170-4bfd-80b3-f9fc7458f4e7 req-be372c1f-10c6-44dd-a495-eadc77f4ca90 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:32.882667 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-5f3a0f2b-7170-4bfd-80b3-f9fc7458f4e7 req-be372c1f-10c6-44dd-a495-eadc77f4ca90 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:32.896203 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-5f3a0f2b-7170-4bfd-80b3-f9fc7458f4e7 req-be372c1f-10c6-44dd-a495-eadc77f4ca90 service nova] Creating event network-changed:ebad17d0-21ab-499a-8323-58c8f38938ef for instance b660fdbd-8dc6-4ed3-81b3-73121c89761a on hv-cinder-84984 Jul 31 18:46:32.901809 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-5f3a0f2b-7170-4bfd-80b3-f9fc7458f4e7 req-be372c1f-10c6-44dd-a495-eadc77f4ca90 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167327 Jul 31 18:46:32.903247 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 448/876] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:46:32.934421 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-b82e2121-ed55-4217-bdff-95a069c9e623 req-28a671c9-bb62-4ced-af2f-ab258f462ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36f18e8e-5304-472a-90f9-7cb6c366c09a", "tag": "b166905f-43cd-4072-a1dd-8c1e432d4400"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:46:32.945270 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell0:SELECT=2 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:46:32.957371 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-b82e2121-ed55-4217-bdff-95a069c9e623 req-28a671c9-bb62-4ced-af2f-ab258f462ea1 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:32.957673 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-b82e2121-ed55-4217-bdff-95a069c9e623 req-28a671c9-bb62-4ced-af2f-ab258f462ea1 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:32.980982 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-b82e2121-ed55-4217-bdff-95a069c9e623 req-28a671c9-bb62-4ced-af2f-ab258f462ea1 service nova] Creating event network-changed:b166905f-43cd-4072-a1dd-8c1e432d4400 for instance 36f18e8e-5304-472a-90f9-7cb6c366c09a on hv-cinder-84984 Jul 31 18:46:32.994097 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-b82e2121-ed55-4217-bdff-95a069c9e623 req-28a671c9-bb62-4ced-af2f-ab258f462ea1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064003 Jul 31 18:46:32.997828 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 429/877] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:46:34.136828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-3ac296fb-9549-4699-89ef-a0406bc1a2c0 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1583832826"}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:46:34.137574 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-3ac296fb-9549-4699-89ef-a0406bc1a2c0 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:34.146463 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3ac296fb-9549-4699-89ef-a0406bc1a2c0 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:34.147242 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3ac296fb-9549-4699-89ef-a0406bc1a2c0 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:34.148287 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3ac296fb-9549-4699-89ef-a0406bc1a2c0 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:34.148943 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3ac296fb-9549-4699-89ef-a0406bc1a2c0 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:34.333316 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.network.security_group_api [None req-3ac296fb-9549-4699-89ef-a0406bc1a2c0 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Adding security group a73e418f-9130-4958-b817-cfbfd6c4ff7b to port b166905f-43cd-4072-a1dd-8c1e432d4400 Jul 31 18:46:34.693849 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-3ac296fb-9549-4699-89ef-a0406bc1a2c0 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "POST /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a/action" status: 202 len: 0 microversion: 2.1 time: 0.564166 Jul 31 18:46:34.695012 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 449/878] 10.222.0.49 () {60 vars in 1278 bytes} [Sun Jul 31 18:46:34 2022] POST /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a/action => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 18:46:34.703872 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-9d7028d1-3f7e-4c37-8d51-e11163c27527 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:34.704593 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-9d7028d1-3f7e-4c37-8d51-e11163c27527 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:34.711215 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9d7028d1-3f7e-4c37-8d51-e11163c27527 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:34.711653 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9d7028d1-3f7e-4c37-8d51-e11163c27527 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:34.712656 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9d7028d1-3f7e-4c37-8d51-e11163c27527 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:34.713144 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9d7028d1-3f7e-4c37-8d51-e11163c27527 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:34.866548 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-9d7028d1-3f7e-4c37-8d51-e11163c27527 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:34.874795 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-9d7028d1-3f7e-4c37-8d51-e11163c27527 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1760 microversion: 2.1 time: 0.175701 Jul 31 18:46:34.875559 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 430/879] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:34 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1760 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:34.916861 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-4cd6bda1-190f-49e1-9f74-ba0289393533 req-7e7ee93f-4d21-4528-85ba-a9b683bb40f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36f18e8e-5304-472a-90f9-7cb6c366c09a", "tag": "b166905f-43cd-4072-a1dd-8c1e432d4400"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:46:34.926731 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-4cd6bda1-190f-49e1-9f74-ba0289393533 req-7e7ee93f-4d21-4528-85ba-a9b683bb40f6 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:34.927240 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-4cd6bda1-190f-49e1-9f74-ba0289393533 req-7e7ee93f-4d21-4528-85ba-a9b683bb40f6 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:34.938706 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-4cd6bda1-190f-49e1-9f74-ba0289393533 req-7e7ee93f-4d21-4528-85ba-a9b683bb40f6 service nova] Creating event network-changed:b166905f-43cd-4072-a1dd-8c1e432d4400 for instance 36f18e8e-5304-472a-90f9-7cb6c366c09a on hv-cinder-84984 Jul 31 18:46:34.943824 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-4cd6bda1-190f-49e1-9f74-ba0289393533 req-7e7ee93f-4d21-4528-85ba-a9b683bb40f6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030699 Jul 31 18:46:34.944500 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 450/880] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:46:57.474878 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-824afb3c-f629-44cd-87ad-6cb71a7034b2 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:46:57.478775 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-824afb3c-f629-44cd-87ad-6cb71a7034b2 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:57.482594 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=9 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:46:57.483673 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=25 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:46:57.494767 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-824afb3c-f629-44cd-87ad-6cb71a7034b2 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:57.495503 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-824afb3c-f629-44cd-87ad-6cb71a7034b2 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:57.496281 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-824afb3c-f629-44cd-87ad-6cb71a7034b2 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:57.496718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-824afb3c-f629-44cd-87ad-6cb71a7034b2 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:57.575434 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-824afb3c-f629-44cd-87ad-6cb71a7034b2 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "POST /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a/action" status: 202 len: 0 microversion: 2.1 time: 0.107036 Jul 31 18:46:57.576082 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 431/881] 10.222.0.49 () {60 vars in 1278 bytes} [Sun Jul 31 18:46:57 2022] POST /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:46:57.582217 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=7 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:46:57.582967 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=24 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:46:57.588047 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-6648e1ad-c61c-44c8-95cd-5ce72fa0eaf6 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:57.588447 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-6648e1ad-c61c-44c8-95cd-5ce72fa0eaf6 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:57.596980 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6648e1ad-c61c-44c8-95cd-5ce72fa0eaf6 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:57.597476 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6648e1ad-c61c-44c8-95cd-5ce72fa0eaf6 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:57.598567 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6648e1ad-c61c-44c8-95cd-5ce72fa0eaf6 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:57.599042 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6648e1ad-c61c-44c8-95cd-5ce72fa0eaf6 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:57.750773 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-6648e1ad-c61c-44c8-95cd-5ce72fa0eaf6 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:57.759336 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-6648e1ad-c61c-44c8-95cd-5ce72fa0eaf6 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1752 microversion: 2.1 time: 0.178700 Jul 31 18:46:57.759936 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 451/882] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:57 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:58.786688 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-d910673b-e826-4eb1-9740-f0cb7b6521af tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:58.787832 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-d910673b-e826-4eb1-9740-f0cb7b6521af tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:58.798486 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d910673b-e826-4eb1-9740-f0cb7b6521af tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:58.799234 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d910673b-e826-4eb1-9740-f0cb7b6521af tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:58.800510 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d910673b-e826-4eb1-9740-f0cb7b6521af tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:58.801273 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d910673b-e826-4eb1-9740-f0cb7b6521af tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:58.949581 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-d910673b-e826-4eb1-9740-f0cb7b6521af tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:46:58.957869 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-d910673b-e826-4eb1-9740-f0cb7b6521af tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1757 microversion: 2.1 time: 0.179053 Jul 31 18:46:58.958444 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 432/883] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:58 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:46:59.984164 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-76a7d0aa-6d5a-4baa-bb34-a16b4966c177 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:46:59.984819 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-76a7d0aa-6d5a-4baa-bb34-a16b4966c177 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:46:59.991985 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-76a7d0aa-6d5a-4baa-bb34-a16b4966c177 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:59.992428 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-76a7d0aa-6d5a-4baa-bb34-a16b4966c177 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:46:59.993238 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-76a7d0aa-6d5a-4baa-bb34-a16b4966c177 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:46:59.993664 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-76a7d0aa-6d5a-4baa-bb34-a16b4966c177 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:00.153016 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-76a7d0aa-6d5a-4baa-bb34-a16b4966c177 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:47:00.164863 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-76a7d0aa-6d5a-4baa-bb34-a16b4966c177 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1757 microversion: 2.1 time: 0.187246 Jul 31 18:47:00.165484 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 452/884] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:46:59 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:47:01.190580 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-12e899ce-af50-49c9-ba81-d03c386a003b tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:47:01.191530 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-12e899ce-af50-49c9-ba81-d03c386a003b tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:47:01.202721 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-12e899ce-af50-49c9-ba81-d03c386a003b tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:01.203476 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-12e899ce-af50-49c9-ba81-d03c386a003b tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:01.204726 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-12e899ce-af50-49c9-ba81-d03c386a003b tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:01.205489 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-12e899ce-af50-49c9-ba81-d03c386a003b tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:01.356234 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-12e899ce-af50-49c9-ba81-d03c386a003b tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:47:01.369183 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-12e899ce-af50-49c9-ba81-d03c386a003b tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1757 microversion: 2.1 time: 0.184988 Jul 31 18:47:01.370014 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 433/885] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:47:01 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:47:02.397467 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-fa64c6dc-342f-42bd-981e-9de895111032 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:47:02.398063 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-fa64c6dc-342f-42bd-981e-9de895111032 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:47:02.404603 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fa64c6dc-342f-42bd-981e-9de895111032 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:02.405474 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fa64c6dc-342f-42bd-981e-9de895111032 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:02.407066 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fa64c6dc-342f-42bd-981e-9de895111032 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:02.407495 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-fa64c6dc-342f-42bd-981e-9de895111032 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:02.786602 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-fa64c6dc-342f-42bd-981e-9de895111032 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:47:02.799284 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-fa64c6dc-342f-42bd-981e-9de895111032 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1757 microversion: 2.1 time: 0.405441 Jul 31 18:47:02.800103 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 453/886] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:47:02 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1757 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:47:03.825955 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-74d7a143-5e25-4e5f-ae55-04d38a8fbe1c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:47:03.827248 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-74d7a143-5e25-4e5f-ae55-04d38a8fbe1c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:47:03.836803 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-74d7a143-5e25-4e5f-ae55-04d38a8fbe1c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:03.837392 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-74d7a143-5e25-4e5f-ae55-04d38a8fbe1c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:03.838398 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-74d7a143-5e25-4e5f-ae55-04d38a8fbe1c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:03.838973 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-74d7a143-5e25-4e5f-ae55-04d38a8fbe1c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:03.990590 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-74d7a143-5e25-4e5f-ae55-04d38a8fbe1c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:47:03.998802 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-74d7a143-5e25-4e5f-ae55-04d38a8fbe1c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1757 microversion: 2.1 time: 0.180063 Jul 31 18:47:03.999369 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 434/887] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:47:03 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:47:05.025341 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-c70552bf-e512-44be-bf5c-82bb4c323eca tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:47:05.026243 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-c70552bf-e512-44be-bf5c-82bb4c323eca tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:47:05.033769 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c70552bf-e512-44be-bf5c-82bb4c323eca tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:05.034214 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c70552bf-e512-44be-bf5c-82bb4c323eca tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:05.034989 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c70552bf-e512-44be-bf5c-82bb4c323eca tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:05.035424 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c70552bf-e512-44be-bf5c-82bb4c323eca tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:05.187640 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-c70552bf-e512-44be-bf5c-82bb4c323eca tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:47:05.195788 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-c70552bf-e512-44be-bf5c-82bb4c323eca tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1757 microversion: 2.1 time: 0.177438 Jul 31 18:47:05.196369 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 454/888] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:47:05 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:47:06.220837 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-76119628-e9d8-4360-8346-102a4329eede tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:47:06.221807 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-76119628-e9d8-4360-8346-102a4329eede tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:47:06.233357 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-76119628-e9d8-4360-8346-102a4329eede tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:06.234139 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-76119628-e9d8-4360-8346-102a4329eede tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:06.235447 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-76119628-e9d8-4360-8346-102a4329eede tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:06.236157 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-76119628-e9d8-4360-8346-102a4329eede tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:06.390872 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-76119628-e9d8-4360-8346-102a4329eede tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:47:06.402790 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-76119628-e9d8-4360-8346-102a4329eede tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1757 microversion: 2.1 time: 0.188579 Jul 31 18:47:06.403345 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 435/889] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:47:06 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:47:07.435957 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-92661221-2714-4249-8f78-510494343925 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:47:07.437025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-92661221-2714-4249-8f78-510494343925 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:47:07.448481 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-92661221-2714-4249-8f78-510494343925 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:07.449299 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-92661221-2714-4249-8f78-510494343925 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:07.450091 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-92661221-2714-4249-8f78-510494343925 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:07.450532 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-92661221-2714-4249-8f78-510494343925 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:07.596469 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-92661221-2714-4249-8f78-510494343925 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:47:07.607508 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-92661221-2714-4249-8f78-510494343925 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1757 microversion: 2.1 time: 0.178471 Jul 31 18:47:07.608078 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 455/890] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:47:07 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:47:08.633531 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-35adefc8-359c-4c56-8497-eea68676086e tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:47:08.634394 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-35adefc8-359c-4c56-8497-eea68676086e tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:47:08.645523 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-35adefc8-359c-4c56-8497-eea68676086e tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:08.646262 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-35adefc8-359c-4c56-8497-eea68676086e tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:08.647516 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-35adefc8-359c-4c56-8497-eea68676086e tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:08.648230 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-35adefc8-359c-4c56-8497-eea68676086e tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:08.799729 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-35adefc8-359c-4c56-8497-eea68676086e tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:47:08.816281 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-35adefc8-359c-4c56-8497-eea68676086e tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1757 microversion: 2.1 time: 0.189836 Jul 31 18:47:08.816857 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 436/891] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:47:08 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:47:09.846695 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-d4441728-5e52-40ab-84df-d77758f3881a tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:47:09.847701 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-d4441728-5e52-40ab-84df-d77758f3881a tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:47:09.858329 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d4441728-5e52-40ab-84df-d77758f3881a tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:09.858772 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d4441728-5e52-40ab-84df-d77758f3881a tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:09.859541 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d4441728-5e52-40ab-84df-d77758f3881a tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:09.859973 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d4441728-5e52-40ab-84df-d77758f3881a tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:10.014642 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-d4441728-5e52-40ab-84df-d77758f3881a tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:47:10.027146 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-d4441728-5e52-40ab-84df-d77758f3881a tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1760 microversion: 2.1 time: 0.186843 Jul 31 18:47:10.027916 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 456/892] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:47:09 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1760 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:47:43.025102 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-cb26c1ae-a211-495b-95de-05b01c2f7bb7 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1583832826"}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:47:43.026153 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-cb26c1ae-a211-495b-95de-05b01c2f7bb7 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:47:43.029317 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=12 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:47:43.030601 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:47:43.038114 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cb26c1ae-a211-495b-95de-05b01c2f7bb7 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:43.038560 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cb26c1ae-a211-495b-95de-05b01c2f7bb7 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:43.039328 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cb26c1ae-a211-495b-95de-05b01c2f7bb7 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:43.039759 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-cb26c1ae-a211-495b-95de-05b01c2f7bb7 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:43.228361 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.network.security_group_api [None req-cb26c1ae-a211-495b-95de-05b01c2f7bb7 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Removing security group a73e418f-9130-4958-b817-cfbfd6c4ff7b from port b166905f-43cd-4072-a1dd-8c1e432d4400 Jul 31 18:47:43.548057 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-cb26c1ae-a211-495b-95de-05b01c2f7bb7 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "POST /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a/action" status: 202 len: 0 microversion: 2.1 time: 0.529738 Jul 31 18:47:43.548986 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 437/893] 10.222.0.49 () {60 vars in 1278 bytes} [Sun Jul 31 18:47:43 2022] POST /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:47:43.560212 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-2543539e-5911-4fa1-90df-561e9d06dc8a req-f71b4362-06b5-401d-8d05-7168cfcaee17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36f18e8e-5304-472a-90f9-7cb6c366c09a", "tag": "b166905f-43cd-4072-a1dd-8c1e432d4400"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:47:43.565983 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=12 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:47:43.577812 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=36 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:47:43.583727 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-2543539e-5911-4fa1-90df-561e9d06dc8a req-f71b4362-06b5-401d-8d05-7168cfcaee17 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:43.584150 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-2543539e-5911-4fa1-90df-561e9d06dc8a req-f71b4362-06b5-401d-8d05-7168cfcaee17 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:43.610868 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-2543539e-5911-4fa1-90df-561e9d06dc8a req-f71b4362-06b5-401d-8d05-7168cfcaee17 service nova] Creating event network-changed:b166905f-43cd-4072-a1dd-8c1e432d4400 for instance 36f18e8e-5304-472a-90f9-7cb6c366c09a on hv-cinder-84984 Jul 31 18:47:43.621828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-2543539e-5911-4fa1-90df-561e9d06dc8a req-f71b4362-06b5-401d-8d05-7168cfcaee17 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065379 Jul 31 18:47:43.626352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 457/894] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:47:44.618889 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-3b5df283-9a0b-43f6-830e-07a7d3594d82 req-4821ceec-7ff8-4101-8cba-008bb7d71707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36f18e8e-5304-472a-90f9-7cb6c366c09a", "tag": "b166905f-43cd-4072-a1dd-8c1e432d4400"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:47:44.625459 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-9a2cd7a2-fb28-49b6-93e8-86dd10d7675e tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:47:44.626314 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-9a2cd7a2-fb28-49b6-93e8-86dd10d7675e tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:47:44.629030 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-3b5df283-9a0b-43f6-830e-07a7d3594d82 req-4821ceec-7ff8-4101-8cba-008bb7d71707 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:44.629660 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-3b5df283-9a0b-43f6-830e-07a7d3594d82 req-4821ceec-7ff8-4101-8cba-008bb7d71707 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:44.632715 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9a2cd7a2-fb28-49b6-93e8-86dd10d7675e tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:44.633189 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9a2cd7a2-fb28-49b6-93e8-86dd10d7675e tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:44.633950 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9a2cd7a2-fb28-49b6-93e8-86dd10d7675e tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:44.634555 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9a2cd7a2-fb28-49b6-93e8-86dd10d7675e tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:44.641138 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-3b5df283-9a0b-43f6-830e-07a7d3594d82 req-4821ceec-7ff8-4101-8cba-008bb7d71707 service nova] Creating event network-changed:b166905f-43cd-4072-a1dd-8c1e432d4400 for instance 36f18e8e-5304-472a-90f9-7cb6c366c09a on hv-cinder-84984 Jul 31 18:47:44.646149 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-3b5df283-9a0b-43f6-830e-07a7d3594d82 req-4821ceec-7ff8-4101-8cba-008bb7d71707 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031891 Jul 31 18:47:44.646921 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 458/895] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:47:44.724267 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.objects.instance [None req-9a2cd7a2-fb28-49b6-93e8-86dd10d7675e tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lazy-loading 'services' on Instance uuid 36f18e8e-5304-472a-90f9-7cb6c366c09a {{(pid=124333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:47:44.808932 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-9a2cd7a2-fb28-49b6-93e8-86dd10d7675e tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "DELETE /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a/os-volume_attachments/b01e269a-a446-4919-9047-78d1a83d8c22" status: 202 len: 0 microversion: 2.1 time: 0.199768 Jul 31 18:47:44.810052 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 438/896] 10.222.0.49 () {58 vars in 1416 bytes} [Sun Jul 31 18:47:44 2022] DELETE /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a/os-volume_attachments/b01e269a-a446-4919-9047-78d1a83d8c22 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:47:44.819348 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-beb2e990-b983-47be-8cd0-a72132ac2c16 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:47:44.822182 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-beb2e990-b983-47be-8cd0-a72132ac2c16 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:47:44.829780 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-beb2e990-b983-47be-8cd0-a72132ac2c16 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:44.830574 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-beb2e990-b983-47be-8cd0-a72132ac2c16 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:44.831658 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-beb2e990-b983-47be-8cd0-a72132ac2c16 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:44.832184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-beb2e990-b983-47be-8cd0-a72132ac2c16 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:44.867351 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-beb2e990-b983-47be-8cd0-a72132ac2c16 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052613 Jul 31 18:47:44.868526 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 459/897] 10.222.0.49 () {58 vars in 1302 bytes} [Sun Jul 31 18:47:44 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:47:45.886302 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-5ff5470e-38b0-48a8-a3b3-2d2ed6379cf2 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:47:45.889975 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-5ff5470e-38b0-48a8-a3b3-2d2ed6379cf2 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:47:45.900646 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5ff5470e-38b0-48a8-a3b3-2d2ed6379cf2 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:45.901439 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5ff5470e-38b0-48a8-a3b3-2d2ed6379cf2 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:45.902707 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5ff5470e-38b0-48a8-a3b3-2d2ed6379cf2 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:45.903433 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5ff5470e-38b0-48a8-a3b3-2d2ed6379cf2 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:45.933422 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-5ff5470e-38b0-48a8-a3b3-2d2ed6379cf2 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055263 Jul 31 18:47:45.933959 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 439/898] 10.222.0.49 () {58 vars in 1302 bytes} [Sun Jul 31 18:47:45 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 18:47:45.944998 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-efe337f8-ba25-471a-860d-b8668954475d tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:47:45.945527 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-efe337f8-ba25-471a-860d-b8668954475d tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:47:45.952253 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-efe337f8-ba25-471a-860d-b8668954475d tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:45.952698 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-efe337f8-ba25-471a-860d-b8668954475d tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:45.953495 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-efe337f8-ba25-471a-860d-b8668954475d tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:45.953925 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-efe337f8-ba25-471a-860d-b8668954475d tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:46.146969 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-efe337f8-ba25-471a-860d-b8668954475d tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] HTTP exception thrown: Instance 36f18e8e-5304-472a-90f9-7cb6c366c09a is not attached to volume b01e269a-a446-4919-9047-78d1a83d8c22 Jul 31 18:47:46.149377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-efe337f8-ba25-471a-860d-b8668954475d tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Request method failure captured: Jul 31 18:47:46.149377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: DELETE /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a/os-volume_attachments/b01e269a-a446-4919-9047-78d1a83d8c22 HTTP/1.1 Jul 31 18:47:46.149377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:47:46.149377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:47:46.149377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:47:46.149377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 0 Jul 31 18:47:46.149377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:47:46.149377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:47:46.149377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:47:46.149377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:47:46.149377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5s3PfUR6I869qxvvMyoFpQHVGGrvNGIhgbwTBYY8hMdHT4a-vKOM-kTxnPlxq2YD9GbcyQBadWqtDwsxyOVAurQGpNcIqTfG1dTEAeH_Q7Kg2zlbksygJbmiMI6xSTzf31sKOXwPKkC7D5gf_0NXWSIkn0QRkqOCMDl8dSe6MRWbGUY Jul 31 18:47:46.149377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:47:46.149377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:47:46.149377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:47:46.149377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:47:46.149377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:47:46.149377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:47:46.149377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: 897eef74408f4973bfb541b7f92365c7 Jul 31 18:47:46.149377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-TestMinimumBasicScenario-1000879937 Jul 31 18:47:46.149377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:47:46.149377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:47:46.151074 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/897eef74408f4973bfb541b7f92365c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_897eef74408f4973bfb541b7f92365c7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/897eef74408f4973bfb541b7f92365c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/897eef74408f4973bfb541b7f92365c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:47:46.151074 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-TestMinimumBasicScenario-1000879937 Jul 31 18:47:46.151074 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: 897eef74408f4973bfb541b7f92365c7 Jul 31 18:47:46.151074 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1000879937 Jul 31 18:47:46.151074 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-TestMinimumBasicScenario-1000879937-project Jul 31 18:47:46.151074 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:47:46.151074 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:47:46.151074 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: 08ee7fc8c18641b2ac4c1400638d54f1 Jul 31 18:47:46.151074 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-TestMinimumBasicScenario-1000879937-project Jul 31 18:47:46.151074 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: > Jul 31 18:47:46.151074 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Instance 36f18e8e-5304-472a-90f9-7cb6c366c09a is not attached to volume b01e269a-a446-4919-9047-78d1a83d8c22 Jul 31 18:47:46.152072 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'server_id': '36f18e8e-5304-472a-90f9-7cb6c366c09a', 'id': 'b01e269a-a446-4919-9047-78d1a83d8c22'} Jul 31 18:47:46.152072 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:47:46.152072 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:47:46.152072 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 31 18:47:46.152072 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 31 18:47:46.152072 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 18:47:46.152072 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 18:47:46.152072 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 31 18:47:46.152072 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 31 18:47:46.152072 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b01e269a-a446-4919-9047-78d1a83d8c22. Jul 31 18:47:46.152072 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:47:46.152072 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:47:46.152072 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:47:46.152072 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:47:46.152072 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:47:46.152072 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:47:46.152072 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:47:46.152072 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:47:46.152072 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:47:46.153663 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:47:46.153663 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 31 18:47:46.153663 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 31 18:47:46.153663 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36f18e8e-5304-472a-90f9-7cb6c366c09a is not attached to volume b01e269a-a446-4919-9047-78d1a83d8c22 Jul 31 18:47:46.153663 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:47:46.153663 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:47:46.153663 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:47:46.153663 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:47:46.153663 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:47:46.153663 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:47:46.153663 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:47:46.153663 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:47:46.153663 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36f18e8e-5304-472a-90f9-7cb6c366c09a is not attached to volume b01e269a-a446-4919-9047-78d1a83d8c22 Jul 31 18:47:46.153663 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:47:46.153663 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-efe337f8-ba25-471a-860d-b8668954475d tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Returning 404 to user: Instance 36f18e8e-5304-472a-90f9-7cb6c366c09a is not attached to volume b01e269a-a446-4919-9047-78d1a83d8c22 {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:47:46.154846 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-efe337f8-ba25-471a-860d-b8668954475d tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "DELETE /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a/os-volume_attachments/b01e269a-a446-4919-9047-78d1a83d8c22" status: 404 len: 154 microversion: 2.1 time: 0.209933 Jul 31 18:47:46.154846 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 460/899] 10.222.0.49 () {58 vars in 1416 bytes} [Sun Jul 31 18:47:45 2022] DELETE /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a/os-volume_attachments/b01e269a-a446-4919-9047-78d1a83d8c22 => generated 154 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:47:47.326696 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-3cbfdc93-799d-4970-b84c-e2b4feb10665 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:47:47.327181 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-3cbfdc93-799d-4970-b84c-e2b4feb10665 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:47:47.334054 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3cbfdc93-799d-4970-b84c-e2b4feb10665 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:47.334510 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3cbfdc93-799d-4970-b84c-e2b4feb10665 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:47.335277 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3cbfdc93-799d-4970-b84c-e2b4feb10665 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:47.335712 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3cbfdc93-799d-4970-b84c-e2b4feb10665 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:47.360254 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-3cbfdc93-799d-4970-b84c-e2b4feb10665 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Going to try to terminate instance {{(pid=124333) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 18:47:47.439980 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-3cbfdc93-799d-4970-b84c-e2b4feb10665 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "DELETE /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 204 len: 0 microversion: 2.1 time: 0.116898 Jul 31 18:47:47.440897 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 440/900] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:47:47 2022] DELETE /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 18:47:47.449348 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-31dd2306-3ad4-4bf1-92b4-b1e10eaafcee tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:47:47.449924 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-31dd2306-3ad4-4bf1-92b4-b1e10eaafcee tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:47:47.456566 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-31dd2306-3ad4-4bf1-92b4-b1e10eaafcee tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:47.457029 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-31dd2306-3ad4-4bf1-92b4-b1e10eaafcee tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:47.458163 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-31dd2306-3ad4-4bf1-92b4-b1e10eaafcee tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:47.459162 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-31dd2306-3ad4-4bf1-92b4-b1e10eaafcee tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:47.590509 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-31dd2306-3ad4-4bf1-92b4-b1e10eaafcee tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:47:47.598126 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-31dd2306-3ad4-4bf1-92b4-b1e10eaafcee tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1554 microversion: 2.1 time: 0.152726 Jul 31 18:47:47.598687 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 461/901] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:47:47 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:47:48.624458 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-70b7a1d5-7910-4307-ae22-dbf5f21b1e04 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:47:48.625476 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-70b7a1d5-7910-4307-ae22-dbf5f21b1e04 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:47:48.636818 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-70b7a1d5-7910-4307-ae22-dbf5f21b1e04 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:48.637574 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-70b7a1d5-7910-4307-ae22-dbf5f21b1e04 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:48.638818 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-70b7a1d5-7910-4307-ae22-dbf5f21b1e04 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:48.639639 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-70b7a1d5-7910-4307-ae22-dbf5f21b1e04 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:48.779850 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-70b7a1d5-7910-4307-ae22-dbf5f21b1e04 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:47:48.788720 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-70b7a1d5-7910-4307-ae22-dbf5f21b1e04 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1554 microversion: 2.1 time: 0.171402 Jul 31 18:47:48.789327 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 441/902] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:47:48 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:47:49.604850 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-49ae559d-fc2b-4b49-8e16-8cec01022427 req-c7d7e66d-efae-41fe-a77a-7d497976f891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f18e8e-5304-472a-90f9-7cb6c366c09a", "name": "network-vif-deleted", "tag": "b166905f-43cd-4072-a1dd-8c1e432d4400"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:47:49.618321 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-49ae559d-fc2b-4b49-8e16-8cec01022427 req-c7d7e66d-efae-41fe-a77a-7d497976f891 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:49.618759 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-49ae559d-fc2b-4b49-8e16-8cec01022427 req-c7d7e66d-efae-41fe-a77a-7d497976f891 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:49.630802 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-49ae559d-fc2b-4b49-8e16-8cec01022427 req-c7d7e66d-efae-41fe-a77a-7d497976f891 service nova] Creating event network-vif-deleted:b166905f-43cd-4072-a1dd-8c1e432d4400 for instance 36f18e8e-5304-472a-90f9-7cb6c366c09a on hv-cinder-84984 Jul 31 18:47:49.637134 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-49ae559d-fc2b-4b49-8e16-8cec01022427 req-c7d7e66d-efae-41fe-a77a-7d497976f891 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036041 Jul 31 18:47:49.637718 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 462/903] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:47:49.811345 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-3e2da4f9-c9d9-44d6-9d16-59b0ea3a82ac tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:47:49.811940 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-3e2da4f9-c9d9-44d6-9d16-59b0ea3a82ac tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:47:49.819106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3e2da4f9-c9d9-44d6-9d16-59b0ea3a82ac tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:49.819559 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3e2da4f9-c9d9-44d6-9d16-59b0ea3a82ac tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:49.820334 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3e2da4f9-c9d9-44d6-9d16-59b0ea3a82ac tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:49.820777 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3e2da4f9-c9d9-44d6-9d16-59b0ea3a82ac tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:49.851864 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3e2da4f9-c9d9-44d6-9d16-59b0ea3a82ac tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:49.852308 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3e2da4f9-c9d9-44d6-9d16-59b0ea3a82ac tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:49.852753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.objects.instance [None req-3e2da4f9-c9d9-44d6-9d16-59b0ea3a82ac tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lazy-loading 'fault' on Instance uuid 36f18e8e-5304-472a-90f9-7cb6c366c09a {{(pid=124333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:47:49.895889 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-3e2da4f9-c9d9-44d6-9d16-59b0ea3a82ac tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ee7fc8c18641b2ac4c1400638d54f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897eef74408f4973bfb541b7f92365c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:47:49.903739 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-3e2da4f9-c9d9-44d6-9d16-59b0ea3a82ac tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 200 len: 1348 microversion: 2.1 time: 0.096596 Jul 31 18:47:49.904317 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 442/904] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:47:49 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 1348 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:47:50.931153 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-847b0ce0-2d4f-42e5-b781-5d946bed214c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:47:50.932269 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-847b0ce0-2d4f-42e5-b781-5d946bed214c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] [instance: 36f18e8e-5304-472a-90f9-7cb6c366c09a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:47:50.942780 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-847b0ce0-2d4f-42e5-b781-5d946bed214c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:50.943226 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-847b0ce0-2d4f-42e5-b781-5d946bed214c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:50.944000 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-847b0ce0-2d4f-42e5-b781-5d946bed214c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:47:50.944431 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-847b0ce0-2d4f-42e5-b781-5d946bed214c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:47:50.958719 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-847b0ce0-2d4f-42e5-b781-5d946bed214c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] HTTP exception thrown: Instance 36f18e8e-5304-472a-90f9-7cb6c366c09a could not be found. Jul 31 18:47:50.960384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-847b0ce0-2d4f-42e5-b781-5d946bed214c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Request method failure captured: Jul 31 18:47:50.960384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a HTTP/1.1 Jul 31 18:47:50.960384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:47:50.960384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:47:50.960384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:47:50.960384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 0 Jul 31 18:47:50.960384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:47:50.960384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:47:50.960384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:47:50.960384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:47:50.960384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5s3PfUR6I869qxvvMyoFpQHVGGrvNGIhgbwTBYY8hMdHT4a-vKOM-kTxnPlxq2YD9GbcyQBadWqtDwsxyOVAurQGpNcIqTfG1dTEAeH_Q7Kg2zlbksygJbmiMI6xSTzf31sKOXwPKkC7D5gf_0NXWSIkn0QRkqOCMDl8dSe6MRWbGUY Jul 31 18:47:50.960384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:47:50.960384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:47:50.960384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:47:50.960384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:47:50.960384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:47:50.960384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:47:50.960384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: 897eef74408f4973bfb541b7f92365c7 Jul 31 18:47:50.960384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-TestMinimumBasicScenario-1000879937 Jul 31 18:47:50.960384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:47:50.960384 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:47:50.961839 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/897eef74408f4973bfb541b7f92365c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_897eef74408f4973bfb541b7f92365c7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/897eef74408f4973bfb541b7f92365c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/897eef74408f4973bfb541b7f92365c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:47:50.961839 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-TestMinimumBasicScenario-1000879937 Jul 31 18:47:50.961839 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: 897eef74408f4973bfb541b7f92365c7 Jul 31 18:47:50.961839 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1000879937 Jul 31 18:47:50.961839 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-TestMinimumBasicScenario-1000879937-project Jul 31 18:47:50.961839 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:47:50.961839 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:47:50.961839 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: 08ee7fc8c18641b2ac4c1400638d54f1 Jul 31 18:47:50.961839 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-TestMinimumBasicScenario-1000879937-project Jul 31 18:47:50.961839 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: > Jul 31 18:47:50.961839 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Instance 36f18e8e-5304-472a-90f9-7cb6c366c09a could not be found. Jul 31 18:47:50.961839 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'id': '36f18e8e-5304-472a-90f9-7cb6c366c09a'} Jul 31 18:47:50.962600 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:47:50.962600 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:47:50.962600 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:47:50.962600 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:47:50.962600 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:47:50.962600 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:47:50.962600 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:47:50.962600 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:47:50.962600 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:47:50.962600 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:47:50.962600 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36f18e8e-5304-472a-90f9-7cb6c366c09a could not be found. Jul 31 18:47:50.962600 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:47:50.962600 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:47:50.962600 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:47:50.962600 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:47:50.962600 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:47:50.962600 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:47:50.962600 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:47:50.962600 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:47:50.962600 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:47:50.964032 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:47:50.964032 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:47:50.964032 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:47:50.964032 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:47:50.964032 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:47:50.964032 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:47:50.964032 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:47:50.964032 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36f18e8e-5304-472a-90f9-7cb6c366c09a could not be found. Jul 31 18:47:50.964032 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:47:50.964032 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:47:50.964032 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:47:50.964032 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:47:50.964032 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:47:50.964032 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:47:50.964032 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:47:50.964032 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:47:50.964032 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36f18e8e-5304-472a-90f9-7cb6c366c09a could not be found. Jul 31 18:47:50.964032 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:47:50.965372 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-847b0ce0-2d4f-42e5-b781-5d946bed214c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Returning 404 to user: Instance 36f18e8e-5304-472a-90f9-7cb6c366c09a could not be found. {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:47:50.965372 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-847b0ce0-2d4f-42e5-b781-5d946bed214c tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a" status: 404 len: 111 microversion: 2.1 time: 0.038201 Jul 31 18:47:50.965372 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 463/905] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:47:50 2022] GET /compute/v2.1/servers/36f18e8e-5304-472a-90f9-7cb6c366c09a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:47:50.973372 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-1af1856f-7d77-4f96-8661-6f81b72cced0 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] Calling method '.version_select at 0x7f8709f8a160>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:47:50.995335 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-1af1856f-7d77-4f96-8661-6f81b72cced0 tempest-TestMinimumBasicScenario-1000879937 tempest-TestMinimumBasicScenario-1000879937-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1684975059" status: 202 len: 0 microversion: 2.1 time: 0.028056 Jul 31 18:47:50.995877 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 443/906] 10.222.0.49 () {58 vars in 1272 bytes} [Sun Jul 31 18:47:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1684975059 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:48:08.545881 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=14 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:48:08.546849 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=26 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:48:08.711770 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-82ee93bf-f9cd-4125-8134-de31d80fef17 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Action: 'create', calling method: .version_select at 0x7f870983cee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1973180684", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVZed7Lqm0SOjGYfd1PQYzS1MJZVd+oWYg+Ueszim3vhWbltJxN7Zz1Cc0dTb/LdYYkTnvCLxK7w9owyAB5v5yLo3+kcmj/EhIyymkyzGkQnqNm7q1djT9AEsF6H6SJVw=="}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:48:08.728232 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.quota [None req-82ee93bf-f9cd-4125-8134-de31d80fef17 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Getting quotas for project 0bef4721a1fe41d8a8ec8013079a9a93. Resources: {'key_pairs'} {{(pid=124334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:48:08.732130 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.quota [None req-82ee93bf-f9cd-4125-8134-de31d80fef17 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Getting quotas for user 1159df549a4b43a9958f389801be2272 and project 0bef4721a1fe41d8a8ec8013079a9a93. Resources: {'key_pairs'} {{(pid=124334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:48:08.756371 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-82ee93bf-f9cd-4125-8134-de31d80fef17 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.215592 Jul 31 18:48:08.757160 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 464/907] 10.222.0.49 () {60 vars in 1159 bytes} [Sun Jul 31 18:48:08 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:48:23.981788 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:48:23.982530 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:48:23.986751 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-dbda1525-bc5f-407e-9a2b-e13d36ddfb3c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1755403553", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1973180684", "security_groups": [{"name": "tempest-secgroup-smoke-2042273479"}], "networks": [{"uuid": "970d0d34-b03e-469b-a59e-24bd4dc3b605"}], "block_device_mapping_v2": [{"uuid": "0f138b40-ad91-43be-a297-a04fb3da73de", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:48:24.119990 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.network.neutron [None req-dbda1525-bc5f-407e-9a2b-e13d36ddfb3c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] validate_networks() for [('970d0d34-b03e-469b-a59e-24bd4dc3b605', None, None, None, None, None)] {{(pid=124333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 18:48:24.611688 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-dbda1525-bc5f-407e-9a2b-e13d36ddfb3c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Flavor limits 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 18:48:24.612107 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-dbda1525-bc5f-407e-9a2b-e13d36ddfb3c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Image limits 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 18:48:24.612573 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-dbda1525-bc5f-407e-9a2b-e13d36ddfb3c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Flavor pref 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 18:48:24.613010 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-dbda1525-bc5f-407e-9a2b-e13d36ddfb3c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Image pref 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 18:48:24.613416 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-dbda1525-bc5f-407e-9a2b-e13d36ddfb3c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 18:48:24.622970 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-dbda1525-bc5f-407e-9a2b-e13d36ddfb3c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:24.623407 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-dbda1525-bc5f-407e-9a2b-e13d36ddfb3c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:24.624192 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-dbda1525-bc5f-407e-9a2b-e13d36ddfb3c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:24.624616 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-dbda1525-bc5f-407e-9a2b-e13d36ddfb3c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:24.641718 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-dbda1525-bc5f-407e-9a2b-e13d36ddfb3c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Getting quotas for project 0bef4721a1fe41d8a8ec8013079a9a93. Resources: {'cores', 'ram', 'instances'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:48:24.645956 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-dbda1525-bc5f-407e-9a2b-e13d36ddfb3c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Getting quotas for user 1159df549a4b43a9958f389801be2272 and project 0bef4721a1fe41d8a8ec8013079a9a93. Resources: {'cores', 'ram', 'instances'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:48:24.702961 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-dbda1525-bc5f-407e-9a2b-e13d36ddfb3c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Going to run 1 instances... {{(pid=124333) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 18:48:24.705117 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-dbda1525-bc5f-407e-9a2b-e13d36ddfb3c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0f138b40-ad91-43be-a297-a04fb3da73de',volume_size=None,volume_type=None)] {{(pid=124333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 18:48:24.857154 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dbda1525-bc5f-407e-9a2b-e13d36ddfb3c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [53371c11-c7e3-48c2-80e1-c4327bc4abd7] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 31 18:48:25.866569 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO oslo.messaging._drivers.impl_rabbit [None req-dbda1525-bc5f-407e-9a2b-e13d36ddfb3c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [53371c11-c7e3-48c2-80e1-c4327bc4abd7] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 52584. Jul 31 18:48:25.871619 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-dbda1525-bc5f-407e-9a2b-e13d36ddfb3c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.891563 Jul 31 18:48:25.872318 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 444/908] 10.222.0.49 () {60 vars in 1147 bytes} [Sun Jul 31 18:48:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 18:48:25.884330 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-95185811-0b02-4155-bb3a-d1dcc875cbb3 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:25.885019 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-95185811-0b02-4155-bb3a-d1dcc875cbb3 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:25.888544 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell0:SELECT=4 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:48:25.889185 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:48:25.945343 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-95185811-0b02-4155-bb3a-d1dcc875cbb3 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:25.952209 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-95185811-0b02-4155-bb3a-d1dcc875cbb3 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1089 microversion: 2.1 time: 0.072048 Jul 31 18:48:25.952805 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 465/909] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:25 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1089 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:26.973769 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-543865fd-8409-484b-8047-9f43adf29c30 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:26.975053 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-543865fd-8409-484b-8047-9f43adf29c30 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:26.983952 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-543865fd-8409-484b-8047-9f43adf29c30 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:26.984692 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-543865fd-8409-484b-8047-9f43adf29c30 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:26.985766 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-543865fd-8409-484b-8047-9f43adf29c30 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:26.986440 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-543865fd-8409-484b-8047-9f43adf29c30 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:27.060495 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-543865fd-8409-484b-8047-9f43adf29c30 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:27.067873 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-543865fd-8409-484b-8047-9f43adf29c30 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1195 microversion: 2.1 time: 0.099087 Jul 31 18:48:27.077296 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 445/910] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:26 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1195 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:28.091899 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-3fe66b65-cb84-4b6c-9abc-8a40af8e4b20 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:28.093380 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-3fe66b65-cb84-4b6c-9abc-8a40af8e4b20 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:28.102665 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3fe66b65-cb84-4b6c-9abc-8a40af8e4b20 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:28.103268 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3fe66b65-cb84-4b6c-9abc-8a40af8e4b20 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:28.104230 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3fe66b65-cb84-4b6c-9abc-8a40af8e4b20 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:28.104877 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3fe66b65-cb84-4b6c-9abc-8a40af8e4b20 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:28.251695 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-3fe66b65-cb84-4b6c-9abc-8a40af8e4b20 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:28.259850 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-3fe66b65-cb84-4b6c-9abc-8a40af8e4b20 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1261 microversion: 2.1 time: 0.172101 Jul 31 18:48:28.260507 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 466/911] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:28 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:48:28.712374 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-7b231a3b-5ef0-4729-b61a-ec4d4d1ab842 req-74a7f032-0a5a-48a0-950f-35318c12834e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48b93fac-2357-4427-b964-61861f4a6eb6", "tag": "10a698cd-e799-4f45-b46b-884f622481bf"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:48:28.723973 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-7b231a3b-5ef0-4729-b61a-ec4d4d1ab842 req-74a7f032-0a5a-48a0-950f-35318c12834e service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:28.724438 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-7b231a3b-5ef0-4729-b61a-ec4d4d1ab842 req-74a7f032-0a5a-48a0-950f-35318c12834e service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:28.735396 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-7b231a3b-5ef0-4729-b61a-ec4d4d1ab842 req-74a7f032-0a5a-48a0-950f-35318c12834e service nova] Creating event network-changed:10a698cd-e799-4f45-b46b-884f622481bf for instance 48b93fac-2357-4427-b964-61861f4a6eb6 on hv-cinder-84984 Jul 31 18:48:28.740841 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-7b231a3b-5ef0-4729-b61a-ec4d4d1ab842 req-74a7f032-0a5a-48a0-950f-35318c12834e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097513 Jul 31 18:48:28.742693 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 446/912] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:48:29.281674 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-0f241d21-263f-4c63-b7f2-8845d22544c8 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:29.282288 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-0f241d21-263f-4c63-b7f2-8845d22544c8 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:29.289688 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0f241d21-263f-4c63-b7f2-8845d22544c8 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:29.290138 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0f241d21-263f-4c63-b7f2-8845d22544c8 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:29.290912 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0f241d21-263f-4c63-b7f2-8845d22544c8 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:29.291356 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-0f241d21-263f-4c63-b7f2-8845d22544c8 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:29.441637 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-0f241d21-263f-4c63-b7f2-8845d22544c8 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:29.450988 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-0f241d21-263f-4c63-b7f2-8845d22544c8 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1261 microversion: 2.1 time: 0.173361 Jul 31 18:48:29.451832 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 467/913] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:29 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:30.206820 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-048b3423-707a-4cbd-a402-d60232f8b80c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:30.207486 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-048b3423-707a-4cbd-a402-d60232f8b80c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: b660fdbd-8dc6-4ed3-81b3-73121c89761a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:30.215695 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-048b3423-707a-4cbd-a402-d60232f8b80c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:30.216213 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-048b3423-707a-4cbd-a402-d60232f8b80c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:30.217175 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-048b3423-707a-4cbd-a402-d60232f8b80c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:30.217681 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-048b3423-707a-4cbd-a402-d60232f8b80c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:30.244817 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-048b3423-707a-4cbd-a402-d60232f8b80c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: b660fdbd-8dc6-4ed3-81b3-73121c89761a] Going to try to terminate instance {{(pid=124333) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 18:48:30.337674 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-048b3423-707a-4cbd-a402-d60232f8b80c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a" status: 204 len: 0 microversion: 2.1 time: 0.135549 Jul 31 18:48:30.339365 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 447/914] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:48:30 2022] DELETE /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 18:48:30.350560 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-da0fe2ff-4a12-4dec-99d7-a5dfd9b7fd06 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:30.351235 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-da0fe2ff-4a12-4dec-99d7-a5dfd9b7fd06 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: b660fdbd-8dc6-4ed3-81b3-73121c89761a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:30.359323 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-da0fe2ff-4a12-4dec-99d7-a5dfd9b7fd06 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:30.359765 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-da0fe2ff-4a12-4dec-99d7-a5dfd9b7fd06 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:30.360518 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-da0fe2ff-4a12-4dec-99d7-a5dfd9b7fd06 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:30.360981 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-da0fe2ff-4a12-4dec-99d7-a5dfd9b7fd06 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:30.473492 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-215ff871-27b9-4f55-9a47-95d31c8d889c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:30.474084 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-215ff871-27b9-4f55-9a47-95d31c8d889c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:30.480229 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-215ff871-27b9-4f55-9a47-95d31c8d889c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:30.480669 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-215ff871-27b9-4f55-9a47-95d31c8d889c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:30.481770 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-215ff871-27b9-4f55-9a47-95d31c8d889c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:30.482205 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-215ff871-27b9-4f55-9a47-95d31c8d889c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:30.496783 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-da0fe2ff-4a12-4dec-99d7-a5dfd9b7fd06 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:30.505266 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-da0fe2ff-4a12-4dec-99d7-a5dfd9b7fd06 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a" status: 200 len: 1578 microversion: 2.1 time: 0.161213 Jul 31 18:48:30.505811 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 468/915] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:30 2022] GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:30.621315 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-215ff871-27b9-4f55-9a47-95d31c8d889c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:30.629752 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-215ff871-27b9-4f55-9a47-95d31c8d889c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1261 microversion: 2.1 time: 0.160916 Jul 31 18:48:30.630313 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 448/916] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:30 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:48:31.526055 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-ef39c3d2-6da8-4b95-b0c2-467334261cc2 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:31.526638 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-ef39c3d2-6da8-4b95-b0c2-467334261cc2 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: b660fdbd-8dc6-4ed3-81b3-73121c89761a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:31.533650 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ef39c3d2-6da8-4b95-b0c2-467334261cc2 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:31.534090 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ef39c3d2-6da8-4b95-b0c2-467334261cc2 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:31.534845 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ef39c3d2-6da8-4b95-b0c2-467334261cc2 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:31.535279 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ef39c3d2-6da8-4b95-b0c2-467334261cc2 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:31.650733 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-598d9800-5288-49ff-9914-9939adc2be35 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:31.651288 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-598d9800-5288-49ff-9914-9939adc2be35 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:31.658053 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-598d9800-5288-49ff-9914-9939adc2be35 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:31.658491 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-598d9800-5288-49ff-9914-9939adc2be35 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:31.659245 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-598d9800-5288-49ff-9914-9939adc2be35 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:31.659676 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-598d9800-5288-49ff-9914-9939adc2be35 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:31.669924 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-ef39c3d2-6da8-4b95-b0c2-467334261cc2 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:31.677839 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-ef39c3d2-6da8-4b95-b0c2-467334261cc2 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a" status: 200 len: 1578 microversion: 2.1 time: 0.155736 Jul 31 18:48:31.678401 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 469/917] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:31 2022] GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:31.789801 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-598d9800-5288-49ff-9914-9939adc2be35 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:31.800024 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-598d9800-5288-49ff-9914-9939adc2be35 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1261 microversion: 2.1 time: 0.152907 Jul 31 18:48:31.800817 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 449/918] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:31 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:48:32.699926 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-52011984-23cf-428c-b37c-5847699fdeeb tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:32.705586 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-c63c0abe-5303-4eaf-8939-15971b2a6ea5 req-62f06924-f368-470e-bacf-dd7ff9f70a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b660fdbd-8dc6-4ed3-81b3-73121c89761a", "name": "network-vif-deleted", "tag": "ebad17d0-21ab-499a-8323-58c8f38938ef"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:48:32.706939 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-52011984-23cf-428c-b37c-5847699fdeeb tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: b660fdbd-8dc6-4ed3-81b3-73121c89761a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:32.720353 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-52011984-23cf-428c-b37c-5847699fdeeb tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:32.724328 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-c63c0abe-5303-4eaf-8939-15971b2a6ea5 req-62f06924-f368-470e-bacf-dd7ff9f70a0a service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:32.725022 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-52011984-23cf-428c-b37c-5847699fdeeb tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:32.725951 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-52011984-23cf-428c-b37c-5847699fdeeb tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:32.726403 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-52011984-23cf-428c-b37c-5847699fdeeb tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:32.731418 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-c63c0abe-5303-4eaf-8939-15971b2a6ea5 req-62f06924-f368-470e-bacf-dd7ff9f70a0a service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:32.742975 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-c63c0abe-5303-4eaf-8939-15971b2a6ea5 req-62f06924-f368-470e-bacf-dd7ff9f70a0a service nova] Creating event network-vif-deleted:ebad17d0-21ab-499a-8323-58c8f38938ef for instance b660fdbd-8dc6-4ed3-81b3-73121c89761a on hv-cinder-84984 Jul 31 18:48:32.754662 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-c63c0abe-5303-4eaf-8939-15971b2a6ea5 req-62f06924-f368-470e-bacf-dd7ff9f70a0a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052944 Jul 31 18:48:32.755268 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 450/919] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:48:32.815264 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-52011984-23cf-428c-b37c-5847699fdeeb tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:32.825240 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-52011984-23cf-428c-b37c-5847699fdeeb tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a" status: 200 len: 1226 microversion: 2.1 time: 0.128828 Jul 31 18:48:32.825954 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 470/920] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:32 2022] GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a => generated 1226 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:32.840159 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-3feea6e8-4e24-4c64-9749-26f55b39309b tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:32.842572 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-3feea6e8-4e24-4c64-9749-26f55b39309b tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:32.849693 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3feea6e8-4e24-4c64-9749-26f55b39309b tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:32.850358 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3feea6e8-4e24-4c64-9749-26f55b39309b tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:32.851358 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3feea6e8-4e24-4c64-9749-26f55b39309b tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:32.851989 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3feea6e8-4e24-4c64-9749-26f55b39309b tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:32.997263 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-3feea6e8-4e24-4c64-9749-26f55b39309b tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:33.005948 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-3feea6e8-4e24-4c64-9749-26f55b39309b tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1261 microversion: 2.1 time: 0.182389 Jul 31 18:48:33.006961 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 451/921] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:32 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:33.854341 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-1b28675e-cd8f-4412-8c0a-33a55227ba30 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:33.855280 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-1b28675e-cd8f-4412-8c0a-33a55227ba30 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: b660fdbd-8dc6-4ed3-81b3-73121c89761a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:33.862289 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1b28675e-cd8f-4412-8c0a-33a55227ba30 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:33.862724 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1b28675e-cd8f-4412-8c0a-33a55227ba30 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:33.863484 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1b28675e-cd8f-4412-8c0a-33a55227ba30 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:33.863918 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1b28675e-cd8f-4412-8c0a-33a55227ba30 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:33.877756 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-1b28675e-cd8f-4412-8c0a-33a55227ba30 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] HTTP exception thrown: Instance b660fdbd-8dc6-4ed3-81b3-73121c89761a could not be found. Jul 31 18:48:33.879307 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-1b28675e-cd8f-4412-8c0a-33a55227ba30 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Request method failure captured: Jul 31 18:48:33.879307 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a HTTP/1.1 Jul 31 18:48:33.879307 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:48:33.879307 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:48:33.879307 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:48:33.879307 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 0 Jul 31 18:48:33.879307 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:48:33.879307 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:48:33.879307 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:48:33.879307 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:48:33.879307 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5s3bC3k69B3jZmJOmo1KbmUV2obujTk7HT8uZ4b1X76LBJZA6DUZzarRVS2pzVXF4ztEZUJX3Bx63LFGTL34ydJTS4JZpsRP6SAK3NnzyKHxL6_kFfTsp-FCDCeOZGmibRya77SPDY2Wr6U-G0QTv0j2EGAPZqqC64v7MhvsGfDuI8o Jul 31 18:48:33.879307 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:48:33.879307 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:48:33.879307 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:48:33.879307 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:48:33.879307 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:48:33.879307 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:48:33.879307 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: 11018257977c4b8ba8f008c0c6ae65fd Jul 31 18:48:33.879307 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-TestVolumeBootPattern-1549899629 Jul 31 18:48:33.879307 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:48:33.879307 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:48:33.880967 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/11018257977c4b8ba8f008c0c6ae65fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_11018257977c4b8ba8f008c0c6ae65fd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/11018257977c4b8ba8f008c0c6ae65fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/11018257977c4b8ba8f008c0c6ae65fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:48:33.880967 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-TestVolumeBootPattern-1549899629 Jul 31 18:48:33.880967 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: 11018257977c4b8ba8f008c0c6ae65fd Jul 31 18:48:33.880967 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-TestVolumeBootPattern-1549899629 Jul 31 18:48:33.880967 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-TestVolumeBootPattern-1549899629-project Jul 31 18:48:33.880967 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:48:33.880967 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:48:33.880967 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: 64d0451d06294c968712f411f90f224e Jul 31 18:48:33.880967 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-TestVolumeBootPattern-1549899629-project Jul 31 18:48:33.880967 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: > Jul 31 18:48:33.880967 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Instance b660fdbd-8dc6-4ed3-81b3-73121c89761a could not be found. Jul 31 18:48:33.880967 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'id': 'b660fdbd-8dc6-4ed3-81b3-73121c89761a'} Jul 31 18:48:33.881825 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:48:33.881825 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:48:33.881825 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:48:33.881825 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:48:33.881825 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:48:33.881825 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:48:33.881825 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:48:33.881825 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:48:33.881825 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:48:33.881825 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:48:33.881825 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b660fdbd-8dc6-4ed3-81b3-73121c89761a could not be found. Jul 31 18:48:33.881825 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:48:33.881825 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:48:33.881825 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:48:33.881825 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:48:33.881825 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:48:33.881825 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:48:33.881825 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:48:33.881825 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:48:33.881825 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:48:33.883119 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:48:33.883119 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:48:33.883119 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:48:33.883119 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:48:33.883119 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:48:33.883119 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:48:33.883119 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:48:33.883119 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b660fdbd-8dc6-4ed3-81b3-73121c89761a could not be found. Jul 31 18:48:33.883119 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:48:33.883119 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:48:33.883119 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:48:33.883119 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:48:33.883119 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:48:33.883119 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:48:33.883119 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:48:33.883119 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:48:33.883119 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b660fdbd-8dc6-4ed3-81b3-73121c89761a could not be found. Jul 31 18:48:33.883119 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:48:33.884286 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-1b28675e-cd8f-4412-8c0a-33a55227ba30 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Returning 404 to user: Instance b660fdbd-8dc6-4ed3-81b3-73121c89761a could not be found. {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:48:33.884286 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-1b28675e-cd8f-4412-8c0a-33a55227ba30 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a" status: 404 len: 111 microversion: 2.1 time: 0.032878 Jul 31 18:48:33.884286 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 471/922] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:33 2022] GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:48:33.983626 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-41877dae-b649-4611-b431-80e6fe0b35c3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1329070214", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1726321377", "security_groups": [{"name": "tempest-secgroup-smoke-1256128819"}], "block_device_mapping_v2": [{"uuid": "1e90b877-e53a-40d9-9cdf-14ba5222b16e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f19c9398-32c7-4fbb-be0b-42ad6f2a09f6"}]}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:48:34.027678 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-7e8b8076-3a07-49f1-9c91-5bdd43b7c376 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:34.028402 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-7e8b8076-3a07-49f1-9c91-5bdd43b7c376 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:34.034909 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7e8b8076-3a07-49f1-9c91-5bdd43b7c376 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:34.035357 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7e8b8076-3a07-49f1-9c91-5bdd43b7c376 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:34.036205 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7e8b8076-3a07-49f1-9c91-5bdd43b7c376 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:34.036631 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7e8b8076-3a07-49f1-9c91-5bdd43b7c376 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:34.098240 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.network.neutron [None req-41877dae-b649-4611-b431-80e6fe0b35c3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] validate_networks() for [('f19c9398-32c7-4fbb-be0b-42ad6f2a09f6', None, None, None, None, None)] {{(pid=124333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 18:48:34.168685 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-7e8b8076-3a07-49f1-9c91-5bdd43b7c376 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:34.176869 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-7e8b8076-3a07-49f1-9c91-5bdd43b7c376 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1261 microversion: 2.1 time: 0.153201 Jul 31 18:48:34.177422 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 472/923] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:34 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:34.472139 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-41877dae-b649-4611-b431-80e6fe0b35c3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Flavor limits 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 18:48:34.472556 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-41877dae-b649-4611-b431-80e6fe0b35c3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Image limits 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 18:48:34.473064 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-41877dae-b649-4611-b431-80e6fe0b35c3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Flavor pref 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 18:48:34.473467 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-41877dae-b649-4611-b431-80e6fe0b35c3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Image pref 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 18:48:34.473899 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-41877dae-b649-4611-b431-80e6fe0b35c3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 18:48:34.483568 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-41877dae-b649-4611-b431-80e6fe0b35c3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:34.484007 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-41877dae-b649-4611-b431-80e6fe0b35c3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:34.484788 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-41877dae-b649-4611-b431-80e6fe0b35c3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:34.485256 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-41877dae-b649-4611-b431-80e6fe0b35c3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:34.502344 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-41877dae-b649-4611-b431-80e6fe0b35c3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Getting quotas for project 11018257977c4b8ba8f008c0c6ae65fd. Resources: {'cores', 'ram', 'instances'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:48:34.506518 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-41877dae-b649-4611-b431-80e6fe0b35c3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Getting quotas for user 64d0451d06294c968712f411f90f224e and project 11018257977c4b8ba8f008c0c6ae65fd. Resources: {'cores', 'ram', 'instances'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:48:34.563383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-41877dae-b649-4611-b431-80e6fe0b35c3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Going to run 1 instances... {{(pid=124333) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 18:48:34.565558 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-41877dae-b649-4611-b431-80e6fe0b35c3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1e90b877-e53a-40d9-9cdf-14ba5222b16e',volume_size=None,volume_type=None)] {{(pid=124333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 18:48:34.705978 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-41877dae-b649-4611-b431-80e6fe0b35c3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.726432 Jul 31 18:48:34.706647 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 452/924] 10.222.0.49 () {60 vars in 1147 bytes} [Sun Jul 31 18:48:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 18:48:34.717731 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-ac67fd6b-001e-46f2-a1a8-5107c202707f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:34.718337 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-ac67fd6b-001e-46f2-a1a8-5107c202707f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:34.770587 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-ac67fd6b-001e-46f2-a1a8-5107c202707f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:34.777644 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-ac67fd6b-001e-46f2-a1a8-5107c202707f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f" status: 200 len: 1095 microversion: 2.1 time: 0.063771 Jul 31 18:48:34.778133 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 473/925] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:34 2022] GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:35.202908 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-da27db1a-2349-4e40-bf3c-46dba65e8b51 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:35.204616 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-da27db1a-2349-4e40-bf3c-46dba65e8b51 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:35.217425 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-da27db1a-2349-4e40-bf3c-46dba65e8b51 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:35.217901 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-da27db1a-2349-4e40-bf3c-46dba65e8b51 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:35.218678 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-da27db1a-2349-4e40-bf3c-46dba65e8b51 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:35.219081 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-da27db1a-2349-4e40-bf3c-46dba65e8b51 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:35.368805 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-da27db1a-2349-4e40-bf3c-46dba65e8b51 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:35.378132 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-da27db1a-2349-4e40-bf3c-46dba65e8b51 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1261 microversion: 2.1 time: 0.182920 Jul 31 18:48:35.378697 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 453/926] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:35 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:35.803217 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-fa9e284c-0d08-4456-8a71-79ab8e2d25f5 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:35.803856 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-fa9e284c-0d08-4456-8a71-79ab8e2d25f5 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:35.866702 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-fa9e284c-0d08-4456-8a71-79ab8e2d25f5 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:35.873640 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-fa9e284c-0d08-4456-8a71-79ab8e2d25f5 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f" status: 200 len: 1095 microversion: 2.1 time: 0.074418 Jul 31 18:48:35.874202 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 474/927] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:35 2022] GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:36.399773 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-ab3ec499-59c5-4e66-98e4-ea20dffa8806 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:36.400419 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-ab3ec499-59c5-4e66-98e4-ea20dffa8806 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:36.407276 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ab3ec499-59c5-4e66-98e4-ea20dffa8806 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:36.407714 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ab3ec499-59c5-4e66-98e4-ea20dffa8806 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:36.408472 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ab3ec499-59c5-4e66-98e4-ea20dffa8806 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:36.408923 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ab3ec499-59c5-4e66-98e4-ea20dffa8806 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:36.542881 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-ab3ec499-59c5-4e66-98e4-ea20dffa8806 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:36.550746 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-ab3ec499-59c5-4e66-98e4-ea20dffa8806 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1261 microversion: 2.1 time: 0.155617 Jul 31 18:48:36.551313 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 454/928] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:36 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:36.894527 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-8ba4b4ad-5fea-4fda-9ade-a4e814f4c97c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:36.895165 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-8ba4b4ad-5fea-4fda-9ade-a4e814f4c97c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:36.951025 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-8ba4b4ad-5fea-4fda-9ade-a4e814f4c97c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:36.957780 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-8ba4b4ad-5fea-4fda-9ade-a4e814f4c97c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f" status: 200 len: 1095 microversion: 2.1 time: 0.067154 Jul 31 18:48:36.958532 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 475/929] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:36 2022] GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:37.571953 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-91608991-3f4f-4cf9-9fa2-604072e8fd69 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:37.572548 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-91608991-3f4f-4cf9-9fa2-604072e8fd69 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:37.579519 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-91608991-3f4f-4cf9-9fa2-604072e8fd69 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:37.579987 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-91608991-3f4f-4cf9-9fa2-604072e8fd69 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:37.580754 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-91608991-3f4f-4cf9-9fa2-604072e8fd69 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:37.581229 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-91608991-3f4f-4cf9-9fa2-604072e8fd69 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:37.724188 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-91608991-3f4f-4cf9-9fa2-604072e8fd69 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:37.732142 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-91608991-3f4f-4cf9-9fa2-604072e8fd69 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1261 microversion: 2.1 time: 0.164192 Jul 31 18:48:37.732692 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 455/930] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:37 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:37.986293 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-22b40df5-3712-42ce-a73b-1c66897a9372 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:37.987288 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-22b40df5-3712-42ce-a73b-1c66897a9372 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:38.044815 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-22b40df5-3712-42ce-a73b-1c66897a9372 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:38.052185 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-22b40df5-3712-42ce-a73b-1c66897a9372 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f" status: 200 len: 1095 microversion: 2.1 time: 0.073981 Jul 31 18:48:38.052754 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 476/931] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:37 2022] GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:38.759887 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-fecb8e19-d90c-4e51-8977-d35b8bbcfb96 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:38.760470 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-fecb8e19-d90c-4e51-8977-d35b8bbcfb96 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:38.766938 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-fecb8e19-d90c-4e51-8977-d35b8bbcfb96 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:38.767379 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-fecb8e19-d90c-4e51-8977-d35b8bbcfb96 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:38.768145 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-fecb8e19-d90c-4e51-8977-d35b8bbcfb96 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:38.768602 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-fecb8e19-d90c-4e51-8977-d35b8bbcfb96 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:38.902847 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-fecb8e19-d90c-4e51-8977-d35b8bbcfb96 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:38.910754 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-fecb8e19-d90c-4e51-8977-d35b8bbcfb96 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1261 microversion: 2.1 time: 0.154903 Jul 31 18:48:38.911300 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 456/932] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:38 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:39.073519 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-f550c528-4f8b-4b01-ba42-b7182cd416ae tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:39.074263 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-f550c528-4f8b-4b01-ba42-b7182cd416ae tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:39.080613 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f550c528-4f8b-4b01-ba42-b7182cd416ae tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:39.081229 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f550c528-4f8b-4b01-ba42-b7182cd416ae tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:39.082014 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f550c528-4f8b-4b01-ba42-b7182cd416ae tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:39.082443 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-f550c528-4f8b-4b01-ba42-b7182cd416ae tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:39.133014 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-ee36ae67-3c44-4c2b-aed5-381e110e8537 req-aafd003f-0c91-441b-b735-f0ce9a1a8d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b93fac-2357-4427-b964-61861f4a6eb6", "name": "network-vif-plugged", "status": "completed", "tag": "10a698cd-e799-4f45-b46b-884f622481bf"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:48:39.143255 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-ee36ae67-3c44-4c2b-aed5-381e110e8537 req-aafd003f-0c91-441b-b735-f0ce9a1a8d40 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:39.143865 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-ee36ae67-3c44-4c2b-aed5-381e110e8537 req-aafd003f-0c91-441b-b735-f0ce9a1a8d40 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:39.148551 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-f550c528-4f8b-4b01-ba42-b7182cd416ae tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:39.156526 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-f550c528-4f8b-4b01-ba42-b7182cd416ae tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f" status: 200 len: 1145 microversion: 2.1 time: 0.087674 Jul 31 18:48:39.157666 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 457/933] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:39 2022] GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:39.158050 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-ee36ae67-3c44-4c2b-aed5-381e110e8537 req-aafd003f-0c91-441b-b735-f0ce9a1a8d40 service nova] Creating event network-vif-plugged:10a698cd-e799-4f45-b46b-884f622481bf for instance 48b93fac-2357-4427-b964-61861f4a6eb6 on hv-cinder-84984 Jul 31 18:48:39.163226 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-ee36ae67-3c44-4c2b-aed5-381e110e8537 req-aafd003f-0c91-441b-b735-f0ce9a1a8d40 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098939 Jul 31 18:48:39.164354 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 477/934] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:48:39.931590 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-3caed015-20f6-4013-b92e-b95cc1524ca8 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:39.932899 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-3caed015-20f6-4013-b92e-b95cc1524ca8 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:39.939902 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3caed015-20f6-4013-b92e-b95cc1524ca8 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:39.940627 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3caed015-20f6-4013-b92e-b95cc1524ca8 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:39.941604 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3caed015-20f6-4013-b92e-b95cc1524ca8 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:39.942033 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3caed015-20f6-4013-b92e-b95cc1524ca8 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:40.089438 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-3caed015-20f6-4013-b92e-b95cc1524ca8 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:40.101215 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-3caed015-20f6-4013-b92e-b95cc1524ca8 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1261 microversion: 2.1 time: 0.173265 Jul 31 18:48:40.101998 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 458/935] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:39 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:40.183461 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-8a8c28f7-9478-4b93-ad09-5f32adc3f9a8 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:40.185286 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-8a8c28f7-9478-4b93-ad09-5f32adc3f9a8 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:40.199340 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8a8c28f7-9478-4b93-ad09-5f32adc3f9a8 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:40.200086 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8a8c28f7-9478-4b93-ad09-5f32adc3f9a8 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:40.201561 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8a8c28f7-9478-4b93-ad09-5f32adc3f9a8 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:40.202207 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8a8c28f7-9478-4b93-ad09-5f32adc3f9a8 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:40.267452 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-8a8c28f7-9478-4b93-ad09-5f32adc3f9a8 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:40.275491 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-8a8c28f7-9478-4b93-ad09-5f32adc3f9a8 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f" status: 200 len: 1211 microversion: 2.1 time: 0.100030 Jul 31 18:48:40.276046 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 478/936] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:40 2022] GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f => generated 1211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:41.124275 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-bec6d4bb-df95-46d6-81fe-cb103bb6f4e9 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:41.125382 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-bec6d4bb-df95-46d6-81fe-cb103bb6f4e9 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:41.132085 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bec6d4bb-df95-46d6-81fe-cb103bb6f4e9 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:41.132538 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bec6d4bb-df95-46d6-81fe-cb103bb6f4e9 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:41.133349 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bec6d4bb-df95-46d6-81fe-cb103bb6f4e9 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:41.133791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-bec6d4bb-df95-46d6-81fe-cb103bb6f4e9 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:41.296632 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-3de02717-784d-4ec8-9616-a1665fb7dc76 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:41.297352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-3de02717-784d-4ec8-9616-a1665fb7dc76 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:41.304022 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3de02717-784d-4ec8-9616-a1665fb7dc76 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:41.304695 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3de02717-784d-4ec8-9616-a1665fb7dc76 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:41.305502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3de02717-784d-4ec8-9616-a1665fb7dc76 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:41.305941 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3de02717-784d-4ec8-9616-a1665fb7dc76 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:41.350709 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-bec6d4bb-df95-46d6-81fe-cb103bb6f4e9 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:41.358815 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-bec6d4bb-df95-46d6-81fe-cb103bb6f4e9 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1446 microversion: 2.1 time: 0.239085 Jul 31 18:48:41.359369 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 459/937] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:41 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1446 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:41.379462 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-928cd047-8952-401d-84fb-af4c8860d09a tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:41.380139 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-928cd047-8952-401d-84fb-af4c8860d09a tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:41.387674 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-928cd047-8952-401d-84fb-af4c8860d09a tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:41.388175 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-928cd047-8952-401d-84fb-af4c8860d09a tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:41.389187 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-928cd047-8952-401d-84fb-af4c8860d09a tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:41.389787 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-928cd047-8952-401d-84fb-af4c8860d09a tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:41.447272 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-3de02717-784d-4ec8-9616-a1665fb7dc76 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:41.455126 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-3de02717-784d-4ec8-9616-a1665fb7dc76 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f" status: 200 len: 1267 microversion: 2.1 time: 0.162572 Jul 31 18:48:41.455672 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 479/938] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:41 2022] GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:41.586871 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-928cd047-8952-401d-84fb-af4c8860d09a tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:41.594483 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-928cd047-8952-401d-84fb-af4c8860d09a tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1446 microversion: 2.1 time: 0.219243 Jul 31 18:48:41.595057 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 460/939] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:41 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1446 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:41.616681 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-4b6d5cd0-b1ca-4beb-b300-9d06d0d277a4 req-2583f2f0-bfb6-4406-b4a7-c2d4cc636cfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03569973-013c-44c3-9a61-c819f4995a0f", "tag": "19fab060-72a0-4b39-869a-3b38d61a6ffd"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:48:41.630145 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-4b6d5cd0-b1ca-4beb-b300-9d06d0d277a4 req-2583f2f0-bfb6-4406-b4a7-c2d4cc636cfd service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:41.630757 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-4b6d5cd0-b1ca-4beb-b300-9d06d0d277a4 req-2583f2f0-bfb6-4406-b4a7-c2d4cc636cfd service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:41.646030 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-4b6d5cd0-b1ca-4beb-b300-9d06d0d277a4 req-2583f2f0-bfb6-4406-b4a7-c2d4cc636cfd service nova] Creating event network-changed:19fab060-72a0-4b39-869a-3b38d61a6ffd for instance 03569973-013c-44c3-9a61-c819f4995a0f on hv-cinder-84984 Jul 31 18:48:41.650762 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-4b6d5cd0-b1ca-4beb-b300-9d06d0d277a4 req-2583f2f0-bfb6-4406-b4a7-c2d4cc636cfd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038414 Jul 31 18:48:41.652704 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 480/940] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:48:42.476544 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-efb25d43-bcd7-4b36-9ea5-1bdcd2cc1d7d tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:42.477180 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-efb25d43-bcd7-4b36-9ea5-1bdcd2cc1d7d tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:42.484270 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-efb25d43-bcd7-4b36-9ea5-1bdcd2cc1d7d tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:42.484716 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-efb25d43-bcd7-4b36-9ea5-1bdcd2cc1d7d tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:42.485515 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-efb25d43-bcd7-4b36-9ea5-1bdcd2cc1d7d tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:42.485950 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-efb25d43-bcd7-4b36-9ea5-1bdcd2cc1d7d tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:42.505024 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:48:42.720065 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-efb25d43-bcd7-4b36-9ea5-1bdcd2cc1d7d tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:42.729885 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-efb25d43-bcd7-4b36-9ea5-1bdcd2cc1d7d tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f" status: 200 len: 1267 microversion: 2.1 time: 0.257235 Jul 31 18:48:42.730657 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 461/941] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:42 2022] GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f => generated 1267 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:43.751885 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-1551462d-43c8-44ae-a239-bda3f44d3673 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:43.752561 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-1551462d-43c8-44ae-a239-bda3f44d3673 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:43.760382 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1551462d-43c8-44ae-a239-bda3f44d3673 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:43.761405 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1551462d-43c8-44ae-a239-bda3f44d3673 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:43.762018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1551462d-43c8-44ae-a239-bda3f44d3673 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:43.762120 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-1551462d-43c8-44ae-a239-bda3f44d3673 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:43.844527 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-2b875315-7fa3-4fff-aca2-1e8d1843ae26 req-1df0e120-6719-42aa-8e52-dfc4f1ce0d2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48b93fac-2357-4427-b964-61861f4a6eb6", "tag": "10a698cd-e799-4f45-b46b-884f622481bf"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:48:43.855935 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-2b875315-7fa3-4fff-aca2-1e8d1843ae26 req-1df0e120-6719-42aa-8e52-dfc4f1ce0d2f service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:43.856455 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-2b875315-7fa3-4fff-aca2-1e8d1843ae26 req-1df0e120-6719-42aa-8e52-dfc4f1ce0d2f service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:43.867895 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-2b875315-7fa3-4fff-aca2-1e8d1843ae26 req-1df0e120-6719-42aa-8e52-dfc4f1ce0d2f service nova] Creating event network-changed:10a698cd-e799-4f45-b46b-884f622481bf for instance 48b93fac-2357-4427-b964-61861f4a6eb6 on hv-cinder-84984 Jul 31 18:48:43.873549 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-2b875315-7fa3-4fff-aca2-1e8d1843ae26 req-1df0e120-6719-42aa-8e52-dfc4f1ce0d2f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032773 Jul 31 18:48:43.874393 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 462/942] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:48:43.915867 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-1551462d-43c8-44ae-a239-bda3f44d3673 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:43.924577 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-1551462d-43c8-44ae-a239-bda3f44d3673 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f" status: 200 len: 1267 microversion: 2.1 time: 0.177380 Jul 31 18:48:43.925429 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 481/943] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:43 2022] GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:44.946699 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-51fcc575-b68d-4112-bc74-de64e66aef02 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:44.947516 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-51fcc575-b68d-4112-bc74-de64e66aef02 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:44.949494 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell0:SELECT=4 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:48:44.950350 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell0:SELECT=12 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:48:44.957168 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-51fcc575-b68d-4112-bc74-de64e66aef02 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:44.957606 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-51fcc575-b68d-4112-bc74-de64e66aef02 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:44.958370 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-51fcc575-b68d-4112-bc74-de64e66aef02 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:44.958786 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-51fcc575-b68d-4112-bc74-de64e66aef02 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:45.103935 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-51fcc575-b68d-4112-bc74-de64e66aef02 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:45.111966 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-51fcc575-b68d-4112-bc74-de64e66aef02 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f" status: 200 len: 1267 microversion: 2.1 time: 0.169565 Jul 31 18:48:45.112533 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 463/944] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:44 2022] GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:46.138331 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-210682ec-fcec-4b5f-a0d2-09629bf061bf tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:46.139056 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-210682ec-fcec-4b5f-a0d2-09629bf061bf tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:46.148185 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-210682ec-fcec-4b5f-a0d2-09629bf061bf tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:46.148735 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-210682ec-fcec-4b5f-a0d2-09629bf061bf tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:46.149783 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-210682ec-fcec-4b5f-a0d2-09629bf061bf tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:46.150355 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-210682ec-fcec-4b5f-a0d2-09629bf061bf tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:46.290418 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-210682ec-fcec-4b5f-a0d2-09629bf061bf tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:46.301866 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-210682ec-fcec-4b5f-a0d2-09629bf061bf tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f" status: 200 len: 1267 microversion: 2.1 time: 0.169750 Jul 31 18:48:46.302645 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 482/945] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:46 2022] GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:47.327496 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-6c25f4f8-ad95-4c91-8d1a-6ce230e3797f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:47.328474 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-6c25f4f8-ad95-4c91-8d1a-6ce230e3797f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:47.339710 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6c25f4f8-ad95-4c91-8d1a-6ce230e3797f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:47.340150 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6c25f4f8-ad95-4c91-8d1a-6ce230e3797f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:47.340942 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6c25f4f8-ad95-4c91-8d1a-6ce230e3797f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:47.341371 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6c25f4f8-ad95-4c91-8d1a-6ce230e3797f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:47.494212 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-6c25f4f8-ad95-4c91-8d1a-6ce230e3797f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:47.502474 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-6c25f4f8-ad95-4c91-8d1a-6ce230e3797f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f" status: 200 len: 1267 microversion: 2.1 time: 0.181789 Jul 31 18:48:47.503035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 464/946] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:47 2022] GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:48.527232 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-072e9580-43d9-4f78-a4ba-018494d89cbd tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:48.527852 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-072e9580-43d9-4f78-a4ba-018494d89cbd tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:48.530456 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell0:SELECT=10 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:48:48.536266 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-072e9580-43d9-4f78-a4ba-018494d89cbd tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:48.536710 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-072e9580-43d9-4f78-a4ba-018494d89cbd tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:48.537490 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-072e9580-43d9-4f78-a4ba-018494d89cbd tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:48.537916 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-072e9580-43d9-4f78-a4ba-018494d89cbd tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:48.669964 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-072e9580-43d9-4f78-a4ba-018494d89cbd tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:48.677599 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-072e9580-43d9-4f78-a4ba-018494d89cbd tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f" status: 200 len: 1267 microversion: 2.1 time: 0.156984 Jul 31 18:48:48.678181 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 483/947] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:48 2022] GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:49.702726 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-2a47e6e4-396c-41d5-9f9d-df75274569c2 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:49.703770 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-2a47e6e4-396c-41d5-9f9d-df75274569c2 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:49.715114 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2a47e6e4-396c-41d5-9f9d-df75274569c2 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:49.715851 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2a47e6e4-396c-41d5-9f9d-df75274569c2 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:49.717156 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2a47e6e4-396c-41d5-9f9d-df75274569c2 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:49.717879 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-2a47e6e4-396c-41d5-9f9d-df75274569c2 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:49.859974 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-2a47e6e4-396c-41d5-9f9d-df75274569c2 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:49.867804 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-2a47e6e4-396c-41d5-9f9d-df75274569c2 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f" status: 200 len: 1267 microversion: 2.1 time: 0.171653 Jul 31 18:48:49.868392 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 465/948] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:49 2022] GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:50.891311 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-44dc2844-9aec-4b0b-be75-31979ded4a25 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:50.892020 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-44dc2844-9aec-4b0b-be75-31979ded4a25 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:50.902011 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-44dc2844-9aec-4b0b-be75-31979ded4a25 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:50.902454 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-44dc2844-9aec-4b0b-be75-31979ded4a25 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:50.903213 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-44dc2844-9aec-4b0b-be75-31979ded4a25 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:50.903637 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-44dc2844-9aec-4b0b-be75-31979ded4a25 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:51.037937 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-44dc2844-9aec-4b0b-be75-31979ded4a25 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:51.045569 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-44dc2844-9aec-4b0b-be75-31979ded4a25 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f" status: 200 len: 1267 microversion: 2.1 time: 0.159221 Jul 31 18:48:51.046139 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 484/949] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:50 2022] GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:52.071160 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-232c7318-e346-46e7-8576-00448fa136ab tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:52.072312 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-232c7318-e346-46e7-8576-00448fa136ab tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:52.080436 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-232c7318-e346-46e7-8576-00448fa136ab tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:52.080920 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-232c7318-e346-46e7-8576-00448fa136ab tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:52.081721 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-232c7318-e346-46e7-8576-00448fa136ab tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:52.082153 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-232c7318-e346-46e7-8576-00448fa136ab tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:52.227363 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-232c7318-e346-46e7-8576-00448fa136ab tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:52.235218 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-232c7318-e346-46e7-8576-00448fa136ab tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f" status: 200 len: 1267 microversion: 2.1 time: 0.170743 Jul 31 18:48:52.235779 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 466/950] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:52 2022] GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:53.183335 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-8b14d142-9645-42b4-94ba-d41764c00ae3 req-0599fe0e-cf74-478d-a69f-f2dd0174c7c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03569973-013c-44c3-9a61-c819f4995a0f", "name": "network-vif-plugged", "status": "completed", "tag": "19fab060-72a0-4b39-869a-3b38d61a6ffd"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:48:53.193730 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-8b14d142-9645-42b4-94ba-d41764c00ae3 req-0599fe0e-cf74-478d-a69f-f2dd0174c7c1 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:53.194179 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-8b14d142-9645-42b4-94ba-d41764c00ae3 req-0599fe0e-cf74-478d-a69f-f2dd0174c7c1 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:53.206114 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-8b14d142-9645-42b4-94ba-d41764c00ae3 req-0599fe0e-cf74-478d-a69f-f2dd0174c7c1 service nova] Creating event network-vif-plugged:19fab060-72a0-4b39-869a-3b38d61a6ffd for instance 03569973-013c-44c3-9a61-c819f4995a0f on hv-cinder-84984 Jul 31 18:48:53.211083 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-8b14d142-9645-42b4-94ba-d41764c00ae3 req-0599fe0e-cf74-478d-a69f-f2dd0174c7c1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031568 Jul 31 18:48:53.211676 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 485/951] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:48:53.256390 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-8ac239d4-4f08-4b1a-9120-e0bacef555c1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:53.257596 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-8ac239d4-4f08-4b1a-9120-e0bacef555c1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:53.264262 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8ac239d4-4f08-4b1a-9120-e0bacef555c1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:53.264796 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8ac239d4-4f08-4b1a-9120-e0bacef555c1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:53.265585 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8ac239d4-4f08-4b1a-9120-e0bacef555c1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:53.265990 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8ac239d4-4f08-4b1a-9120-e0bacef555c1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:53.416033 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-8ac239d4-4f08-4b1a-9120-e0bacef555c1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:53.423694 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-8ac239d4-4f08-4b1a-9120-e0bacef555c1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f" status: 200 len: 1267 microversion: 2.1 time: 0.171552 Jul 31 18:48:53.424228 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 467/952] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:53 2022] GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:54.449502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-cd5a9064-4a9a-4b1a-9700-57d85f64c5f4 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:54.450167 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-cd5a9064-4a9a-4b1a-9700-57d85f64c5f4 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:54.459592 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cd5a9064-4a9a-4b1a-9700-57d85f64c5f4 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:54.460184 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cd5a9064-4a9a-4b1a-9700-57d85f64c5f4 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:54.461321 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cd5a9064-4a9a-4b1a-9700-57d85f64c5f4 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:54.461866 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-cd5a9064-4a9a-4b1a-9700-57d85f64c5f4 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:54.602093 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-cd5a9064-4a9a-4b1a-9700-57d85f64c5f4 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:54.613927 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-cd5a9064-4a9a-4b1a-9700-57d85f64c5f4 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f" status: 200 len: 1267 microversion: 2.1 time: 0.171566 Jul 31 18:48:54.614788 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 486/953] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:54 2022] GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:55.642657 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-5b536a07-9b48-4a79-9f45-6120099c36d4 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:55.643682 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-5b536a07-9b48-4a79-9f45-6120099c36d4 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:55.647571 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:48:55.657053 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5b536a07-9b48-4a79-9f45-6120099c36d4 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:55.657803 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5b536a07-9b48-4a79-9f45-6120099c36d4 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:55.659075 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5b536a07-9b48-4a79-9f45-6120099c36d4 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:55.659807 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5b536a07-9b48-4a79-9f45-6120099c36d4 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:55.799753 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-5b536a07-9b48-4a79-9f45-6120099c36d4 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:55.810893 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-5b536a07-9b48-4a79-9f45-6120099c36d4 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f" status: 200 len: 1453 microversion: 2.1 time: 0.174758 Jul 31 18:48:55.811669 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 468/954] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:55 2022] GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:55.831471 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-95175dee-9e6d-496a-90d2-890844f16570 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:48:55.832081 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-95175dee-9e6d-496a-90d2-890844f16570 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:48:55.838985 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-95175dee-9e6d-496a-90d2-890844f16570 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:55.839424 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-95175dee-9e6d-496a-90d2-890844f16570 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:55.840212 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-95175dee-9e6d-496a-90d2-890844f16570 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:55.840639 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-95175dee-9e6d-496a-90d2-890844f16570 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:55.981367 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-95175dee-9e6d-496a-90d2-890844f16570 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:48:55.983653 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=91 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:48:55.990597 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-95175dee-9e6d-496a-90d2-890844f16570 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f" status: 200 len: 1453 microversion: 2.1 time: 0.163093 Jul 31 18:48:55.991183 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 487/955] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:48:55 2022] GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:48:57.656580 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-07a10011-66ab-47f0-b65a-ef4e46c99f20 req-ad707e2b-182d-4870-b1dd-7bc6df773903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03569973-013c-44c3-9a61-c819f4995a0f", "tag": "19fab060-72a0-4b39-869a-3b38d61a6ffd"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:48:57.666523 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-07a10011-66ab-47f0-b65a-ef4e46c99f20 req-ad707e2b-182d-4870-b1dd-7bc6df773903 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:48:57.666956 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-07a10011-66ab-47f0-b65a-ef4e46c99f20 req-ad707e2b-182d-4870-b1dd-7bc6df773903 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:48:57.678132 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-07a10011-66ab-47f0-b65a-ef4e46c99f20 req-ad707e2b-182d-4870-b1dd-7bc6df773903 service nova] Creating event network-changed:19fab060-72a0-4b39-869a-3b38d61a6ffd for instance 03569973-013c-44c3-9a61-c819f4995a0f on hv-cinder-84984 Jul 31 18:48:57.683203 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-07a10011-66ab-47f0-b65a-ef4e46c99f20 req-ad707e2b-182d-4870-b1dd-7bc6df773903 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030607 Jul 31 18:48:57.684074 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 469/956] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:49:15.645071 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 18:49:15.645984 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Sun Jul 31 18:49:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 18:50:39.226371 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=56 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:50:39.235162 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-7b164cb0-7d55-4a1e-aa29-1cc68cb325fb tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:50:39.235869 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-7b164cb0-7d55-4a1e-aa29-1cc68cb325fb tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:39.243982 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7b164cb0-7d55-4a1e-aa29-1cc68cb325fb tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:39.244431 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7b164cb0-7d55-4a1e-aa29-1cc68cb325fb tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:39.245424 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7b164cb0-7d55-4a1e-aa29-1cc68cb325fb tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:39.245869 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-7b164cb0-7d55-4a1e-aa29-1cc68cb325fb tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:39.268116 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.objects.instance [None req-7b164cb0-7d55-4a1e-aa29-1cc68cb325fb tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lazy-loading 'flavor' on Instance uuid 48b93fac-2357-4427-b964-61861f4a6eb6 {{(pid=124334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:50:39.346376 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-7b164cb0-7d55-4a1e-aa29-1cc68cb325fb tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "POST /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6/action" status: 202 len: 0 microversion: 2.1 time: 0.121949 Jul 31 18:50:39.346989 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 488/957] 10.222.0.49 () {60 vars in 1278 bytes} [Sun Jul 31 18:50:39 2022] POST /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:50:39.353881 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=3 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:50:39.354644 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=42 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:50:39.359567 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-6a27e58f-7dd5-4aad-a623-3f4b3bb4be41 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:39.360306 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-6a27e58f-7dd5-4aad-a623-3f4b3bb4be41 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:39.367878 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6a27e58f-7dd5-4aad-a623-3f4b3bb4be41 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:39.368305 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6a27e58f-7dd5-4aad-a623-3f4b3bb4be41 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:39.369102 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6a27e58f-7dd5-4aad-a623-3f4b3bb4be41 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:39.369520 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6a27e58f-7dd5-4aad-a623-3f4b3bb4be41 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:39.514702 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-6a27e58f-7dd5-4aad-a623-3f4b3bb4be41 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:39.522592 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-6a27e58f-7dd5-4aad-a623-3f4b3bb4be41 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1570 microversion: 2.1 time: 0.170980 Jul 31 18:50:39.523171 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 470/958] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:39 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:40.546421 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-adf5f0df-8ff3-4bd0-ace2-1ef4e744b6b5 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:40.547178 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-adf5f0df-8ff3-4bd0-ace2-1ef4e744b6b5 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:40.556060 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-adf5f0df-8ff3-4bd0-ace2-1ef4e744b6b5 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:40.556614 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-adf5f0df-8ff3-4bd0-ace2-1ef4e744b6b5 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:40.557622 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-adf5f0df-8ff3-4bd0-ace2-1ef4e744b6b5 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:40.558158 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-adf5f0df-8ff3-4bd0-ace2-1ef4e744b6b5 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:40.698434 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-adf5f0df-8ff3-4bd0-ace2-1ef4e744b6b5 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:40.709483 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-adf5f0df-8ff3-4bd0-ace2-1ef4e744b6b5 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1570 microversion: 2.1 time: 0.168632 Jul 31 18:50:40.710058 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 489/959] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:40 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:41.730955 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-3cfc7bcd-7c88-4879-bd6e-d1a3a4f329cf tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:41.731575 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-3cfc7bcd-7c88-4879-bd6e-d1a3a4f329cf tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:41.739389 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3cfc7bcd-7c88-4879-bd6e-d1a3a4f329cf tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:41.739832 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3cfc7bcd-7c88-4879-bd6e-d1a3a4f329cf tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:41.740597 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3cfc7bcd-7c88-4879-bd6e-d1a3a4f329cf tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:41.741067 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3cfc7bcd-7c88-4879-bd6e-d1a3a4f329cf tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:41.888538 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-3cfc7bcd-7c88-4879-bd6e-d1a3a4f329cf tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:41.900505 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-3cfc7bcd-7c88-4879-bd6e-d1a3a4f329cf tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1570 microversion: 2.1 time: 0.173663 Jul 31 18:50:41.901344 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 471/960] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:41 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:42.927481 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-c71e8b51-029a-4784-8437-4afb153ff38a tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:42.928098 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-c71e8b51-029a-4784-8437-4afb153ff38a tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:42.935079 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c71e8b51-029a-4784-8437-4afb153ff38a tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:42.935523 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c71e8b51-029a-4784-8437-4afb153ff38a tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:42.936286 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c71e8b51-029a-4784-8437-4afb153ff38a tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:42.936713 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-c71e8b51-029a-4784-8437-4afb153ff38a tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:43.082205 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-c71e8b51-029a-4784-8437-4afb153ff38a tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:43.090246 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-c71e8b51-029a-4784-8437-4afb153ff38a tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1570 microversion: 2.1 time: 0.167974 Jul 31 18:50:43.090785 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 490/961] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:42 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:44.122856 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-8dbfa5cd-3955-40a3-906b-f116002f519d tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:44.124300 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-8dbfa5cd-3955-40a3-906b-f116002f519d tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:44.133666 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8dbfa5cd-3955-40a3-906b-f116002f519d tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:44.134112 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8dbfa5cd-3955-40a3-906b-f116002f519d tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:44.134881 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8dbfa5cd-3955-40a3-906b-f116002f519d tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:44.135310 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8dbfa5cd-3955-40a3-906b-f116002f519d tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:44.280317 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-8dbfa5cd-3955-40a3-906b-f116002f519d tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:44.288192 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-8dbfa5cd-3955-40a3-906b-f116002f519d tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1570 microversion: 2.1 time: 0.171926 Jul 31 18:50:44.288734 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 472/962] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:44 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:44.351928 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 18:50:44.352142 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Sun Jul 31 18:50:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 18:50:45.321983 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-a732e4f8-c403-48c9-b295-11ff6e0199c4 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:45.322994 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-a732e4f8-c403-48c9-b295-11ff6e0199c4 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:45.334003 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a732e4f8-c403-48c9-b295-11ff6e0199c4 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:45.334614 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a732e4f8-c403-48c9-b295-11ff6e0199c4 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:45.335388 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a732e4f8-c403-48c9-b295-11ff6e0199c4 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:45.335817 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a732e4f8-c403-48c9-b295-11ff6e0199c4 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:45.486790 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-a732e4f8-c403-48c9-b295-11ff6e0199c4 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:45.495759 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-a732e4f8-c403-48c9-b295-11ff6e0199c4 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1570 microversion: 2.1 time: 0.180567 Jul 31 18:50:45.496326 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 491/963] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:45 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1570 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:46.026218 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-acb3f564-0c45-4353-89bc-8415f68ac2d3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1437585270", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1726321377", "security_groups": [{"name": "tempest-secgroup-smoke-1256128819"}], "block_device_mapping_v2": [{"uuid": "f4754fad-0b40-46db-a079-ec412f6a5f43", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f19c9398-32c7-4fbb-be0b-42ad6f2a09f6"}]}} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:50:46.140874 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.network.neutron [None req-acb3f564-0c45-4353-89bc-8415f68ac2d3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] validate_networks() for [('f19c9398-32c7-4fbb-be0b-42ad6f2a09f6', None, None, None, None, None)] {{(pid=124333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 18:50:46.517670 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-65f99f4f-59a8-48ac-bab2-51b3fd2c54b0 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:46.518404 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-65f99f4f-59a8-48ac-bab2-51b3fd2c54b0 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:46.525377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-65f99f4f-59a8-48ac-bab2-51b3fd2c54b0 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:46.525828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-65f99f4f-59a8-48ac-bab2-51b3fd2c54b0 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:46.526585 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-65f99f4f-59a8-48ac-bab2-51b3fd2c54b0 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:46.527029 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-65f99f4f-59a8-48ac-bab2-51b3fd2c54b0 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:46.529733 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-acb3f564-0c45-4353-89bc-8415f68ac2d3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Flavor limits 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 18:50:46.530137 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-acb3f564-0c45-4353-89bc-8415f68ac2d3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Image limits 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 18:50:46.530609 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-acb3f564-0c45-4353-89bc-8415f68ac2d3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Flavor pref 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 18:50:46.531014 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-acb3f564-0c45-4353-89bc-8415f68ac2d3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Image pref 0:0:0 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 18:50:46.531420 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.virt.hardware [None req-acb3f564-0c45-4353-89bc-8415f68ac2d3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 18:50:46.540896 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-acb3f564-0c45-4353-89bc-8415f68ac2d3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:46.541339 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-acb3f564-0c45-4353-89bc-8415f68ac2d3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:46.542147 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-acb3f564-0c45-4353-89bc-8415f68ac2d3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:46.542582 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-acb3f564-0c45-4353-89bc-8415f68ac2d3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:46.559449 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-acb3f564-0c45-4353-89bc-8415f68ac2d3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Getting quotas for project 11018257977c4b8ba8f008c0c6ae65fd. Resources: {'cores', 'ram', 'instances'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 18:50:46.563766 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.quota [None req-acb3f564-0c45-4353-89bc-8415f68ac2d3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Getting quotas for user 64d0451d06294c968712f411f90f224e and project 11018257977c4b8ba8f008c0c6ae65fd. Resources: {'cores', 'ram', 'instances'} {{(pid=124333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 18:50:46.622688 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-acb3f564-0c45-4353-89bc-8415f68ac2d3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Going to run 1 instances... {{(pid=124333) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 18:50:46.625114 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-acb3f564-0c45-4353-89bc-8415f68ac2d3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f4754fad-0b40-46db-a079-ec412f6a5f43',volume_size=None,volume_type=None)] {{(pid=124333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 18:50:46.681586 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-65f99f4f-59a8-48ac-bab2-51b3fd2c54b0 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:46.689409 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-65f99f4f-59a8-48ac-bab2-51b3fd2c54b0 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1570 microversion: 2.1 time: 0.175691 Jul 31 18:50:46.689980 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 492/964] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:46 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:46.756682 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-acb3f564-0c45-4353-89bc-8415f68ac2d3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.734429 Jul 31 18:50:46.757386 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 473/965] 10.222.0.49 () {60 vars in 1147 bytes} [Sun Jul 31 18:50:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 18:50:46.768425 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-fbd27bfb-6304-4dec-9515-49f000a3e577 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:46.769059 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-fbd27bfb-6304-4dec-9515-49f000a3e577 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:46.821162 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-fbd27bfb-6304-4dec-9515-49f000a3e577 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:46.828332 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-fbd27bfb-6304-4dec-9515-49f000a3e577 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6" status: 200 len: 1095 microversion: 2.1 time: 0.064003 Jul 31 18:50:46.828926 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 493/966] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:46 2022] GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6 => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:47.715969 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-d0be5361-fda6-4a32-870f-d66db407cce0 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:47.717071 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-d0be5361-fda6-4a32-870f-d66db407cce0 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:47.727618 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d0be5361-fda6-4a32-870f-d66db407cce0 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:47.728340 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d0be5361-fda6-4a32-870f-d66db407cce0 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:47.730617 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d0be5361-fda6-4a32-870f-d66db407cce0 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:47.731684 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d0be5361-fda6-4a32-870f-d66db407cce0 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:47.849355 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-7466668c-d07d-4038-abd8-105cbca166da tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:47.850155 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-7466668c-d07d-4038-abd8-105cbca166da tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:47.877223 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-d0be5361-fda6-4a32-870f-d66db407cce0 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:47.885316 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-d0be5361-fda6-4a32-870f-d66db407cce0 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1570 microversion: 2.1 time: 0.176662 Jul 31 18:50:47.885912 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 474/967] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:47 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:47.905012 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-7466668c-d07d-4038-abd8-105cbca166da tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:47.912628 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-7466668c-d07d-4038-abd8-105cbca166da tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6" status: 200 len: 1095 microversion: 2.1 time: 0.067156 Jul 31 18:50:47.913227 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 494/968] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:47 2022] GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:47.985201 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 18:50:47.985482 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Sun Jul 31 18:50:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 18:50:48.910326 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-6d1d635e-074a-401d-ab7e-c4c5bee590d1 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:48.911318 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-6d1d635e-074a-401d-ab7e-c4c5bee590d1 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:48.918635 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6d1d635e-074a-401d-ab7e-c4c5bee590d1 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:48.919077 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6d1d635e-074a-401d-ab7e-c4c5bee590d1 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:48.919840 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6d1d635e-074a-401d-ab7e-c4c5bee590d1 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:48.920249 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6d1d635e-074a-401d-ab7e-c4c5bee590d1 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:48.933922 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-2a2c74fb-a3f7-4c98-a6a4-ca2be30c2702 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:48.935451 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-2a2c74fb-a3f7-4c98-a6a4-ca2be30c2702 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:48.994780 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-2a2c74fb-a3f7-4c98-a6a4-ca2be30c2702 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:49.002600 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-2a2c74fb-a3f7-4c98-a6a4-ca2be30c2702 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6" status: 200 len: 1095 microversion: 2.1 time: 0.072983 Jul 31 18:50:49.003361 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 495/969] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:48 2022] GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:49.064393 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-6d1d635e-074a-401d-ab7e-c4c5bee590d1 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:49.075776 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-6d1d635e-074a-401d-ab7e-c4c5bee590d1 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1570 microversion: 2.1 time: 0.171776 Jul 31 18:50:49.076513 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 475/970] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:48 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:50.027925 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-036142bb-6fe8-4dda-b93f-62bf17e2527f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:50.028928 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-036142bb-6fe8-4dda-b93f-62bf17e2527f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:50.089692 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-036142bb-6fe8-4dda-b93f-62bf17e2527f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:50.097407 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-036142bb-6fe8-4dda-b93f-62bf17e2527f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6" status: 200 len: 1095 microversion: 2.1 time: 0.076351 Jul 31 18:50:50.098134 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 496/971] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:50 2022] GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6 => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:50.098621 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-68eeab1e-eac5-410e-bf7d-40170bd1f7ca tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:50.099253 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-68eeab1e-eac5-410e-bf7d-40170bd1f7ca tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:50.105938 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-68eeab1e-eac5-410e-bf7d-40170bd1f7ca tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:50.106428 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-68eeab1e-eac5-410e-bf7d-40170bd1f7ca tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:50.107182 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-68eeab1e-eac5-410e-bf7d-40170bd1f7ca tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:50.107575 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-68eeab1e-eac5-410e-bf7d-40170bd1f7ca tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:50.248277 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-68eeab1e-eac5-410e-bf7d-40170bd1f7ca tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:50.256330 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-68eeab1e-eac5-410e-bf7d-40170bd1f7ca tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1570 microversion: 2.1 time: 0.161601 Jul 31 18:50:50.256951 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 476/972] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:50 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:50:51.123760 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-a0f28a97-5a7a-4070-8d89-cd916e1ac1f3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:51.124437 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-a0f28a97-5a7a-4070-8d89-cd916e1ac1f3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:51.133872 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a0f28a97-5a7a-4070-8d89-cd916e1ac1f3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:51.134321 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a0f28a97-5a7a-4070-8d89-cd916e1ac1f3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:51.135089 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a0f28a97-5a7a-4070-8d89-cd916e1ac1f3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:51.135521 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a0f28a97-5a7a-4070-8d89-cd916e1ac1f3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:51.200866 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-a0f28a97-5a7a-4070-8d89-cd916e1ac1f3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:51.209735 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-a0f28a97-5a7a-4070-8d89-cd916e1ac1f3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6" status: 200 len: 1145 microversion: 2.1 time: 0.092871 Jul 31 18:50:51.210768 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 497/973] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:51 2022] GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6 => generated 1145 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:51.277871 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-26e8fefb-72e2-454f-97ba-8f2e1a5a1377 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:51.278524 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-26e8fefb-72e2-454f-97ba-8f2e1a5a1377 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:51.285402 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-26e8fefb-72e2-454f-97ba-8f2e1a5a1377 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:51.285837 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-26e8fefb-72e2-454f-97ba-8f2e1a5a1377 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:51.286632 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-26e8fefb-72e2-454f-97ba-8f2e1a5a1377 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:51.287058 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-26e8fefb-72e2-454f-97ba-8f2e1a5a1377 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:51.457821 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-26e8fefb-72e2-454f-97ba-8f2e1a5a1377 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:51.465861 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-26e8fefb-72e2-454f-97ba-8f2e1a5a1377 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1570 microversion: 2.1 time: 0.192402 Jul 31 18:50:51.466424 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 477/974] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:51 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1570 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:52.231828 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-6ad75ab4-a591-4f9f-88f5-0f44297fd828 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:52.233103 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-6ad75ab4-a591-4f9f-88f5-0f44297fd828 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:52.240579 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6ad75ab4-a591-4f9f-88f5-0f44297fd828 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:52.241172 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6ad75ab4-a591-4f9f-88f5-0f44297fd828 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:52.242066 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6ad75ab4-a591-4f9f-88f5-0f44297fd828 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:52.242586 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6ad75ab4-a591-4f9f-88f5-0f44297fd828 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:52.304925 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-6ad75ab4-a591-4f9f-88f5-0f44297fd828 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:52.312690 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-6ad75ab4-a591-4f9f-88f5-0f44297fd828 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6" status: 200 len: 1211 microversion: 2.1 time: 0.086110 Jul 31 18:50:52.313292 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 498/975] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:52 2022] GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6 => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:52.489637 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-3772116a-eb4c-4708-83c3-34cdf523d269 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:52.494436 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-3772116a-eb4c-4708-83c3-34cdf523d269 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:52.500183 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3772116a-eb4c-4708-83c3-34cdf523d269 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:52.500645 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3772116a-eb4c-4708-83c3-34cdf523d269 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:52.501455 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3772116a-eb4c-4708-83c3-34cdf523d269 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:52.501880 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3772116a-eb4c-4708-83c3-34cdf523d269 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:52.745978 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-3772116a-eb4c-4708-83c3-34cdf523d269 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:52.755053 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-3772116a-eb4c-4708-83c3-34cdf523d269 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1570 microversion: 2.1 time: 0.271430 Jul 31 18:50:52.755743 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 478/976] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:52 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1570 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:53.334777 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-239cb4b7-2d55-4e49-94e9-fd31ab61d861 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:53.335355 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-239cb4b7-2d55-4e49-94e9-fd31ab61d861 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:53.342861 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-239cb4b7-2d55-4e49-94e9-fd31ab61d861 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:53.343789 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-239cb4b7-2d55-4e49-94e9-fd31ab61d861 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:53.344554 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-239cb4b7-2d55-4e49-94e9-fd31ab61d861 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:53.345246 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-239cb4b7-2d55-4e49-94e9-fd31ab61d861 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:53.481893 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-239cb4b7-2d55-4e49-94e9-fd31ab61d861 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:53.489483 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-239cb4b7-2d55-4e49-94e9-fd31ab61d861 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6" status: 200 len: 1279 microversion: 2.1 time: 0.159227 Jul 31 18:50:53.490133 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 499/977] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:53 2022] GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6 => generated 1279 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:53.776363 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-be45d111-6219-408c-87e6-c26f9095296b tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:53.777000 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-be45d111-6219-408c-87e6-c26f9095296b tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:53.783787 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-be45d111-6219-408c-87e6-c26f9095296b tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:53.784231 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-be45d111-6219-408c-87e6-c26f9095296b tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:53.785031 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-be45d111-6219-408c-87e6-c26f9095296b tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:53.785466 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-be45d111-6219-408c-87e6-c26f9095296b tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:53.914275 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-5088f8ba-d0a1-4732-8b35-820d48cdb62b req-82a4d358-6c93-46cb-aa57-ca4ffec2061f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1be8b918-972d-412f-8a42-73eaa0d73ca6", "tag": "7aa51301-5bd7-4136-b570-23814b380e4d"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:50:53.928659 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-5088f8ba-d0a1-4732-8b35-820d48cdb62b req-82a4d358-6c93-46cb-aa57-ca4ffec2061f service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:53.929642 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-5088f8ba-d0a1-4732-8b35-820d48cdb62b req-82a4d358-6c93-46cb-aa57-ca4ffec2061f service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:53.941708 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-5088f8ba-d0a1-4732-8b35-820d48cdb62b req-82a4d358-6c93-46cb-aa57-ca4ffec2061f service nova] Creating event network-changed:7aa51301-5bd7-4136-b570-23814b380e4d for instance 1be8b918-972d-412f-8a42-73eaa0d73ca6 on hv-cinder-84984 Jul 31 18:50:53.947064 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-5088f8ba-d0a1-4732-8b35-820d48cdb62b req-82a4d358-6c93-46cb-aa57-ca4ffec2061f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043422 Jul 31 18:50:53.947681 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 500/978] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:50:54.027435 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-be45d111-6219-408c-87e6-c26f9095296b tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:54.037771 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-be45d111-6219-408c-87e6-c26f9095296b tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1570 microversion: 2.1 time: 0.265382 Jul 31 18:50:54.038467 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 479/979] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:53 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1570 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:54.512111 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-8023e42c-9da0-47c7-beec-036790652040 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:54.513060 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-8023e42c-9da0-47c7-beec-036790652040 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:54.520085 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8023e42c-9da0-47c7-beec-036790652040 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:54.520502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8023e42c-9da0-47c7-beec-036790652040 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:54.521665 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8023e42c-9da0-47c7-beec-036790652040 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:54.522327 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8023e42c-9da0-47c7-beec-036790652040 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:54.672331 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-8023e42c-9da0-47c7-beec-036790652040 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:54.683598 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-8023e42c-9da0-47c7-beec-036790652040 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6" status: 200 len: 1267 microversion: 2.1 time: 0.176600 Jul 31 18:50:54.684167 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 501/980] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:54 2022] GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:55.059281 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-3259c0d6-7d3e-41c8-af58-782af8f4fcef tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:55.059886 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-3259c0d6-7d3e-41c8-af58-782af8f4fcef tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:55.066653 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3259c0d6-7d3e-41c8-af58-782af8f4fcef tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:55.067115 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3259c0d6-7d3e-41c8-af58-782af8f4fcef tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:55.067874 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3259c0d6-7d3e-41c8-af58-782af8f4fcef tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:55.068298 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-3259c0d6-7d3e-41c8-af58-782af8f4fcef tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:55.308523 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-3259c0d6-7d3e-41c8-af58-782af8f4fcef tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:55.317556 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-3259c0d6-7d3e-41c8-af58-782af8f4fcef tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1511 microversion: 2.1 time: 0.261940 Jul 31 18:50:55.318106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 480/981] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:55 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1511 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:55.338084 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-635ac6aa-1eec-407c-95e2-f5e6e3cf933e tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:50:55.338681 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-635ac6aa-1eec-407c-95e2-f5e6e3cf933e tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:55.345019 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-635ac6aa-1eec-407c-95e2-f5e6e3cf933e tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:55.345478 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-635ac6aa-1eec-407c-95e2-f5e6e3cf933e tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:55.346268 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-635ac6aa-1eec-407c-95e2-f5e6e3cf933e tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:55.346698 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-635ac6aa-1eec-407c-95e2-f5e6e3cf933e tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:55.432078 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-635ac6aa-1eec-407c-95e2-f5e6e3cf933e tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124334) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 31 18:50:55.505872 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-635ac6aa-1eec-407c-95e2-f5e6e3cf933e tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "POST /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6/action" status: 202 len: 0 microversion: 2.1 time: 0.171766 Jul 31 18:50:55.509631 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 502/982] 10.222.0.49 () {60 vars in 1278 bytes} [Sun Jul 31 18:50:55 2022] POST /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:50:55.515088 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-49b529f3-a500-48fa-a401-8bc2201f83f6 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:55.515833 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-49b529f3-a500-48fa-a401-8bc2201f83f6 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:55.522408 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-49b529f3-a500-48fa-a401-8bc2201f83f6 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:55.523017 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-49b529f3-a500-48fa-a401-8bc2201f83f6 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:55.523874 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-49b529f3-a500-48fa-a401-8bc2201f83f6 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:55.524441 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-49b529f3-a500-48fa-a401-8bc2201f83f6 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:55.658153 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-49b529f3-a500-48fa-a401-8bc2201f83f6 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:55.665859 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-49b529f3-a500-48fa-a401-8bc2201f83f6 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1519 microversion: 2.1 time: 0.154839 Jul 31 18:50:55.666423 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 481/983] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:55 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:55.705313 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-310d16e3-a33b-4375-990f-fb060f96111e tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:55.705931 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-310d16e3-a33b-4375-990f-fb060f96111e tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:55.712220 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-310d16e3-a33b-4375-990f-fb060f96111e tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:55.712952 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-310d16e3-a33b-4375-990f-fb060f96111e tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:55.713692 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-310d16e3-a33b-4375-990f-fb060f96111e tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:55.714121 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-310d16e3-a33b-4375-990f-fb060f96111e tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:55.853568 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-310d16e3-a33b-4375-990f-fb060f96111e tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:55.861469 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-310d16e3-a33b-4375-990f-fb060f96111e tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6" status: 200 len: 1267 microversion: 2.1 time: 0.160627 Jul 31 18:50:55.862049 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 503/984] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:55 2022] GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:56.686939 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-ec459280-f243-436e-a8f7-1adb409fc4da tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:56.687602 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-ec459280-f243-436e-a8f7-1adb409fc4da tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:56.689987 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell0:SELECT=2 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:50:56.690685 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell0:SELECT=6 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:50:56.696473 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ec459280-f243-436e-a8f7-1adb409fc4da tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:56.696947 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ec459280-f243-436e-a8f7-1adb409fc4da tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:56.697720 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ec459280-f243-436e-a8f7-1adb409fc4da tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:56.698157 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ec459280-f243-436e-a8f7-1adb409fc4da tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:56.835794 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-ec459280-f243-436e-a8f7-1adb409fc4da tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:56.844687 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-ec459280-f243-436e-a8f7-1adb409fc4da tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1521 microversion: 2.1 time: 0.161678 Jul 31 18:50:56.845308 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 482/985] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:56 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:56.883283 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-6ab516a6-8e9c-4221-b4ac-a421524bbcd0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:56.883845 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-6ab516a6-8e9c-4221-b4ac-a421524bbcd0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:56.890874 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6ab516a6-8e9c-4221-b4ac-a421524bbcd0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:56.891319 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6ab516a6-8e9c-4221-b4ac-a421524bbcd0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:56.892078 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6ab516a6-8e9c-4221-b4ac-a421524bbcd0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:56.892533 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6ab516a6-8e9c-4221-b4ac-a421524bbcd0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:57.031689 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-6ab516a6-8e9c-4221-b4ac-a421524bbcd0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:57.039778 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-6ab516a6-8e9c-4221-b4ac-a421524bbcd0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6" status: 200 len: 1267 microversion: 2.1 time: 0.160536 Jul 31 18:50:57.040356 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 504/986] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:56 2022] GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:57.869142 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-ca60854d-0533-416d-b8b7-3c419c89034c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:57.869749 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-ca60854d-0533-416d-b8b7-3c419c89034c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:57.878052 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ca60854d-0533-416d-b8b7-3c419c89034c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:57.878565 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ca60854d-0533-416d-b8b7-3c419c89034c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:57.879342 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ca60854d-0533-416d-b8b7-3c419c89034c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:57.879812 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-ca60854d-0533-416d-b8b7-3c419c89034c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:57.996501 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-c00817b9-f308-466c-a9ca-62cba5b99bc7 req-0d11566e-1441-4b3f-9039-24eda9aa33a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b93fac-2357-4427-b964-61861f4a6eb6", "name": "network-vif-unplugged", "status": "completed", "tag": "10a698cd-e799-4f45-b46b-884f622481bf"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:50:58.007068 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-c00817b9-f308-466c-a9ca-62cba5b99bc7 req-0d11566e-1441-4b3f-9039-24eda9aa33a6 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:58.007565 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-c00817b9-f308-466c-a9ca-62cba5b99bc7 req-0d11566e-1441-4b3f-9039-24eda9aa33a6 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:58.013605 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-ca60854d-0533-416d-b8b7-3c419c89034c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:58.020083 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-c00817b9-f308-466c-a9ca-62cba5b99bc7 req-0d11566e-1441-4b3f-9039-24eda9aa33a6 service nova] Creating event network-vif-unplugged:10a698cd-e799-4f45-b46b-884f622481bf for instance 48b93fac-2357-4427-b964-61861f4a6eb6 on hv-cinder-84984 Jul 31 18:50:58.021615 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-ca60854d-0533-416d-b8b7-3c419c89034c tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1577 microversion: 2.1 time: 0.156783 Jul 31 18:50:58.022383 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 483/987] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:57 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:58.026081 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-c00817b9-f308-466c-a9ca-62cba5b99bc7 req-0d11566e-1441-4b3f-9039-24eda9aa33a6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033403 Jul 31 18:50:58.026768 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 505/988] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 18:50:58.113722 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-1feddd67-fd42-4ce1-a17f-63ed1385c0f1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:58.114327 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-1feddd67-fd42-4ce1-a17f-63ed1385c0f1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:58.120872 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1feddd67-fd42-4ce1-a17f-63ed1385c0f1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:58.121269 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1feddd67-fd42-4ce1-a17f-63ed1385c0f1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:58.122048 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1feddd67-fd42-4ce1-a17f-63ed1385c0f1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:58.122478 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-1feddd67-fd42-4ce1-a17f-63ed1385c0f1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:58.258977 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-1feddd67-fd42-4ce1-a17f-63ed1385c0f1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:58.266717 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-1feddd67-fd42-4ce1-a17f-63ed1385c0f1 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6" status: 200 len: 1267 microversion: 2.1 time: 0.210051 Jul 31 18:50:58.267288 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 484/989] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:58 2022] GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6 => generated 1267 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 18:50:59.049712 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-980b0357-208c-4b5c-86b7-05a35b189b95 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:59.050857 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-980b0357-208c-4b5c-86b7-05a35b189b95 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:59.061516 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-980b0357-208c-4b5c-86b7-05a35b189b95 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:59.062254 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-980b0357-208c-4b5c-86b7-05a35b189b95 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:59.063511 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-980b0357-208c-4b5c-86b7-05a35b189b95 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:59.064245 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-980b0357-208c-4b5c-86b7-05a35b189b95 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:59.205951 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-980b0357-208c-4b5c-86b7-05a35b189b95 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:59.209398 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:50:59.219378 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-980b0357-208c-4b5c-86b7-05a35b189b95 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1577 microversion: 2.1 time: 0.177700 Jul 31 18:50:59.219987 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 506/990] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:59 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:50:59.291904 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-9cd4dadd-5c20-4ac0-b676-028ed38c16ed tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:50:59.292803 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-9cd4dadd-5c20-4ac0-b676-028ed38c16ed tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:50:59.303279 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9cd4dadd-5c20-4ac0-b676-028ed38c16ed tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:59.303972 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9cd4dadd-5c20-4ac0-b676-028ed38c16ed tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:59.305259 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9cd4dadd-5c20-4ac0-b676-028ed38c16ed tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:50:59.305945 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-9cd4dadd-5c20-4ac0-b676-028ed38c16ed tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:50:59.444363 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-9cd4dadd-5c20-4ac0-b676-028ed38c16ed tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:50:59.452286 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-9cd4dadd-5c20-4ac0-b676-028ed38c16ed tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6" status: 200 len: 1267 microversion: 2.1 time: 0.165272 Jul 31 18:50:59.452809 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 485/991] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:50:59 2022] GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:51:00.243201 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-097aa28c-4a73-4fa3-b8cf-1a0d2777aa81 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:51:00.243807 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-097aa28c-4a73-4fa3-b8cf-1a0d2777aa81 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:51:00.245744 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell0:SELECT=8 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:51:00.252313 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-097aa28c-4a73-4fa3-b8cf-1a0d2777aa81 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:00.252746 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-097aa28c-4a73-4fa3-b8cf-1a0d2777aa81 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:00.253522 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-097aa28c-4a73-4fa3-b8cf-1a0d2777aa81 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:00.253953 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-097aa28c-4a73-4fa3-b8cf-1a0d2777aa81 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:00.397380 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-097aa28c-4a73-4fa3-b8cf-1a0d2777aa81 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:51:00.405582 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-097aa28c-4a73-4fa3-b8cf-1a0d2777aa81 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1577 microversion: 2.1 time: 0.167016 Jul 31 18:51:00.406150 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 507/992] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:51:00 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:51:00.477737 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-6dda354a-d7c0-4852-871e-1cf0b048e123 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:51:00.478303 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-6dda354a-d7c0-4852-871e-1cf0b048e123 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:51:00.486287 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6dda354a-d7c0-4852-871e-1cf0b048e123 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:00.486901 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6dda354a-d7c0-4852-871e-1cf0b048e123 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:00.487980 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6dda354a-d7c0-4852-871e-1cf0b048e123 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:00.488558 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-6dda354a-d7c0-4852-871e-1cf0b048e123 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:00.632252 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-6dda354a-d7c0-4852-871e-1cf0b048e123 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:51:00.640316 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-6dda354a-d7c0-4852-871e-1cf0b048e123 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6" status: 200 len: 1267 microversion: 2.1 time: 0.168930 Jul 31 18:51:00.640918 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 486/993] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:51:00 2022] GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:51:01.430759 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-5ebf215c-5fc2-49f1-ab36-53865c7d9db9 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:51:01.431755 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-5ebf215c-5fc2-49f1-ab36-53865c7d9db9 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:51:01.442766 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5ebf215c-5fc2-49f1-ab36-53865c7d9db9 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:01.443496 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5ebf215c-5fc2-49f1-ab36-53865c7d9db9 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:01.444736 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5ebf215c-5fc2-49f1-ab36-53865c7d9db9 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:01.447657 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-5ebf215c-5fc2-49f1-ab36-53865c7d9db9 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:01.579127 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-5ebf215c-5fc2-49f1-ab36-53865c7d9db9 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:51:01.586917 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-5ebf215c-5fc2-49f1-ab36-53865c7d9db9 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1577 microversion: 2.1 time: 0.162873 Jul 31 18:51:01.587505 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 508/994] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:51:01 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:51:01.672549 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-8e87ffd6-021f-47a3-b412-3a0925491e9b tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:51:01.673575 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-8e87ffd6-021f-47a3-b412-3a0925491e9b tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:51:01.682967 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8e87ffd6-021f-47a3-b412-3a0925491e9b tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:01.683405 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8e87ffd6-021f-47a3-b412-3a0925491e9b tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:01.684164 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8e87ffd6-021f-47a3-b412-3a0925491e9b tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:01.684590 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8e87ffd6-021f-47a3-b412-3a0925491e9b tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:01.688545 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=100 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:51:01.825317 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-8e87ffd6-021f-47a3-b412-3a0925491e9b tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:51:01.833061 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-8e87ffd6-021f-47a3-b412-3a0925491e9b tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6" status: 200 len: 1267 microversion: 2.1 time: 0.166912 Jul 31 18:51:01.833857 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 487/995] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:51:01 2022] GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:51:02.617169 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-ba047dd0-ea39-45da-a57b-a365b0db3924 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:51:02.617894 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-ba047dd0-ea39-45da-a57b-a365b0db3924 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:51:02.625196 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ba047dd0-ea39-45da-a57b-a365b0db3924 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:02.625635 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ba047dd0-ea39-45da-a57b-a365b0db3924 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:02.626424 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ba047dd0-ea39-45da-a57b-a365b0db3924 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:02.626848 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-ba047dd0-ea39-45da-a57b-a365b0db3924 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:02.768068 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-ba047dd0-ea39-45da-a57b-a365b0db3924 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:51:02.779528 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-ba047dd0-ea39-45da-a57b-a365b0db3924 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1577 microversion: 2.1 time: 0.173079 Jul 31 18:51:02.780338 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 509/996] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:51:02 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:51:02.855631 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-89ff5249-e3af-4523-a7db-1235dbac27c0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:51:02.856566 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-89ff5249-e3af-4523-a7db-1235dbac27c0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:51:02.867102 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-89ff5249-e3af-4523-a7db-1235dbac27c0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:02.867885 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-89ff5249-e3af-4523-a7db-1235dbac27c0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:02.869060 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-89ff5249-e3af-4523-a7db-1235dbac27c0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:02.869759 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-89ff5249-e3af-4523-a7db-1235dbac27c0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:03.021147 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-89ff5249-e3af-4523-a7db-1235dbac27c0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:51:03.029384 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-89ff5249-e3af-4523-a7db-1235dbac27c0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6" status: 200 len: 1267 microversion: 2.1 time: 0.179052 Jul 31 18:51:03.029928 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 488/997] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:51:02 2022] GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:51:03.804337 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-099a8e33-6560-4198-9860-4a85c994410f tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:51:03.804984 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-099a8e33-6560-4198-9860-4a85c994410f tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:51:03.812444 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-099a8e33-6560-4198-9860-4a85c994410f tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:03.812918 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-099a8e33-6560-4198-9860-4a85c994410f tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:03.813697 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-099a8e33-6560-4198-9860-4a85c994410f tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:03.814126 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-099a8e33-6560-4198-9860-4a85c994410f tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:03.955448 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-099a8e33-6560-4198-9860-4a85c994410f tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:51:03.963644 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-099a8e33-6560-4198-9860-4a85c994410f tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1577 microversion: 2.1 time: 0.163311 Jul 31 18:51:03.964309 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 510/998] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:51:03 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:51:04.051441 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-917078ae-a313-4d93-8c5e-7d258720d0b3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:51:04.052084 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-917078ae-a313-4d93-8c5e-7d258720d0b3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:51:04.059014 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-917078ae-a313-4d93-8c5e-7d258720d0b3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:04.059465 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-917078ae-a313-4d93-8c5e-7d258720d0b3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:04.060233 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-917078ae-a313-4d93-8c5e-7d258720d0b3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:04.060665 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-917078ae-a313-4d93-8c5e-7d258720d0b3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:04.195444 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-917078ae-a313-4d93-8c5e-7d258720d0b3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:51:04.203202 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-917078ae-a313-4d93-8c5e-7d258720d0b3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6" status: 200 len: 1267 microversion: 2.1 time: 0.155771 Jul 31 18:51:04.203770 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 489/999] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:51:04 2022] GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:51:04.989844 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-6e68b0db-532e-4b54-aea1-e55a37bf3ec5 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:51:04.990768 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-6e68b0db-532e-4b54-aea1-e55a37bf3ec5 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:51:05.002716 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6e68b0db-532e-4b54-aea1-e55a37bf3ec5 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:05.003431 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6e68b0db-532e-4b54-aea1-e55a37bf3ec5 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:05.004700 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6e68b0db-532e-4b54-aea1-e55a37bf3ec5 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:05.005460 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6e68b0db-532e-4b54-aea1-e55a37bf3ec5 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:05.153634 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-6e68b0db-532e-4b54-aea1-e55a37bf3ec5 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:51:05.161804 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-6e68b0db-532e-4b54-aea1-e55a37bf3ec5 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1577 microversion: 2.1 time: 0.178492 Jul 31 18:51:05.162406 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 511/1000] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:51:04 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:51:05.225077 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-77831a3e-9859-4fe2-8a34-d8496f2affe5 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:51:05.225700 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-77831a3e-9859-4fe2-8a34-d8496f2affe5 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:51:05.233129 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-77831a3e-9859-4fe2-8a34-d8496f2affe5 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:05.233653 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-77831a3e-9859-4fe2-8a34-d8496f2affe5 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:05.234470 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-77831a3e-9859-4fe2-8a34-d8496f2affe5 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:05.234905 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-77831a3e-9859-4fe2-8a34-d8496f2affe5 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:05.370726 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-77831a3e-9859-4fe2-8a34-d8496f2affe5 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:51:05.378738 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-77831a3e-9859-4fe2-8a34-d8496f2affe5 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6" status: 200 len: 1267 microversion: 2.1 time: 0.158010 Jul 31 18:51:05.379307 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 490/1001] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:51:05 2022] GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:51:06.100941 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-127fb733-dfef-4a13-8416-dee16375c2d7 req-1776bc78-e8fb-4af8-9d38-ab02f84f03ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be8b918-972d-412f-8a42-73eaa0d73ca6", "name": "network-vif-plugged", "status": "completed", "tag": "7aa51301-5bd7-4136-b570-23814b380e4d"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:51:06.111283 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-127fb733-dfef-4a13-8416-dee16375c2d7 req-1776bc78-e8fb-4af8-9d38-ab02f84f03ee service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:06.111739 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-127fb733-dfef-4a13-8416-dee16375c2d7 req-1776bc78-e8fb-4af8-9d38-ab02f84f03ee service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:06.123506 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-127fb733-dfef-4a13-8416-dee16375c2d7 req-1776bc78-e8fb-4af8-9d38-ab02f84f03ee service nova] Creating event network-vif-plugged:7aa51301-5bd7-4136-b570-23814b380e4d for instance 1be8b918-972d-412f-8a42-73eaa0d73ca6 on hv-cinder-84984 Jul 31 18:51:06.128672 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-127fb733-dfef-4a13-8416-dee16375c2d7 req-1776bc78-e8fb-4af8-9d38-ab02f84f03ee service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031582 Jul 31 18:51:06.129323 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 512/1002] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:51:06.183749 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-92899662-6fc6-4d4a-ae51-f3f98b4c3ce1 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:51:06.184337 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-92899662-6fc6-4d4a-ae51-f3f98b4c3ce1 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:51:06.190963 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-92899662-6fc6-4d4a-ae51-f3f98b4c3ce1 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:06.191410 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-92899662-6fc6-4d4a-ae51-f3f98b4c3ce1 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:06.192177 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-92899662-6fc6-4d4a-ae51-f3f98b4c3ce1 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:06.192613 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-92899662-6fc6-4d4a-ae51-f3f98b4c3ce1 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:06.326686 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-92899662-6fc6-4d4a-ae51-f3f98b4c3ce1 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:51:06.334794 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-92899662-6fc6-4d4a-ae51-f3f98b4c3ce1 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1564 microversion: 2.1 time: 0.155080 Jul 31 18:51:06.335520 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 491/1003] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:51:06 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:51:06.399857 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-86e66359-641e-4110-8e4f-b5c098c2037e tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:51:06.400618 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-86e66359-641e-4110-8e4f-b5c098c2037e tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:51:06.407115 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-86e66359-641e-4110-8e4f-b5c098c2037e tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:06.407798 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-86e66359-641e-4110-8e4f-b5c098c2037e tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:06.408745 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-86e66359-641e-4110-8e4f-b5c098c2037e tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:06.409210 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-86e66359-641e-4110-8e4f-b5c098c2037e tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:06.543835 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-86e66359-641e-4110-8e4f-b5c098c2037e tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:51:06.551410 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-86e66359-641e-4110-8e4f-b5c098c2037e tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6" status: 200 len: 1267 microversion: 2.1 time: 0.155935 Jul 31 18:51:06.552182 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 513/1004] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:51:06 2022] GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:51:07.575796 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-8cbe140b-ef0c-403c-8533-bd83c80dfe6f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:51:07.576455 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-8cbe140b-ef0c-403c-8533-bd83c80dfe6f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:51:07.585314 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8cbe140b-ef0c-403c-8533-bd83c80dfe6f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:07.585913 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8cbe140b-ef0c-403c-8533-bd83c80dfe6f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:07.586879 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8cbe140b-ef0c-403c-8533-bd83c80dfe6f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:07.587402 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8cbe140b-ef0c-403c-8533-bd83c80dfe6f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:07.728517 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-8cbe140b-ef0c-403c-8533-bd83c80dfe6f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:51:07.736417 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-8cbe140b-ef0c-403c-8533-bd83c80dfe6f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6" status: 200 len: 1454 microversion: 2.1 time: 0.165908 Jul 31 18:51:07.737000 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 492/1005] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:51:07 2022] GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6 => generated 1454 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:51:07.757736 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-d1bf4096-0895-47fb-8665-17d0434321b3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:51:07.758345 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-d1bf4096-0895-47fb-8665-17d0434321b3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:51:07.765456 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d1bf4096-0895-47fb-8665-17d0434321b3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:07.765871 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d1bf4096-0895-47fb-8665-17d0434321b3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:07.766677 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d1bf4096-0895-47fb-8665-17d0434321b3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:07.767080 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d1bf4096-0895-47fb-8665-17d0434321b3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:07.903199 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-d1bf4096-0895-47fb-8665-17d0434321b3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:51:07.911187 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-d1bf4096-0895-47fb-8665-17d0434321b3 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6" status: 200 len: 1454 microversion: 2.1 time: 0.157331 Jul 31 18:51:07.911753 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 514/1006] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:51:07 2022] GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6 => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:51:08.143017 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-ef8d5655-1abc-4a8a-b65a-836df7ae84a2 req-bd7a48c7-2936-4b92-a2e9-bbb2389caa29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b93fac-2357-4427-b964-61861f4a6eb6", "name": "network-vif-plugged", "status": "completed", "tag": "10a698cd-e799-4f45-b46b-884f622481bf"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:51:08.152957 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-ef8d5655-1abc-4a8a-b65a-836df7ae84a2 req-bd7a48c7-2936-4b92-a2e9-bbb2389caa29 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:08.153394 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-ef8d5655-1abc-4a8a-b65a-836df7ae84a2 req-bd7a48c7-2936-4b92-a2e9-bbb2389caa29 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:08.164789 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-ef8d5655-1abc-4a8a-b65a-836df7ae84a2 req-bd7a48c7-2936-4b92-a2e9-bbb2389caa29 service nova] Creating event network-vif-plugged:10a698cd-e799-4f45-b46b-884f622481bf for instance 48b93fac-2357-4427-b964-61861f4a6eb6 on hv-cinder-84984 Jul 31 18:51:08.169981 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-ef8d5655-1abc-4a8a-b65a-836df7ae84a2 req-bd7a48c7-2936-4b92-a2e9-bbb2389caa29 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030797 Jul 31 18:51:08.171052 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 493/1007] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:51:09.768502 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-69985cba-b9be-4d1b-9212-cbf289ed7ec2 req-fca99337-3870-4952-8115-4677226025b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1be8b918-972d-412f-8a42-73eaa0d73ca6", "tag": "7aa51301-5bd7-4136-b570-23814b380e4d"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:51:09.773967 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:51:09.779639 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-69985cba-b9be-4d1b-9212-cbf289ed7ec2 req-fca99337-3870-4952-8115-4677226025b4 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:51:09.780163 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-69985cba-b9be-4d1b-9212-cbf289ed7ec2 req-fca99337-3870-4952-8115-4677226025b4 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:51:09.792377 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-69985cba-b9be-4d1b-9212-cbf289ed7ec2 req-fca99337-3870-4952-8115-4677226025b4 service nova] Creating event network-changed:7aa51301-5bd7-4136-b570-23814b380e4d for instance 1be8b918-972d-412f-8a42-73eaa0d73ca6 on hv-cinder-84984 Jul 31 18:51:09.797462 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-69985cba-b9be-4d1b-9212-cbf289ed7ec2 req-fca99337-3870-4952-8115-4677226025b4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032695 Jul 31 18:51:09.798059 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 515/1008] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:52:20.572190 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:52:20.573460 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=36 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:52:20.573790 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=47 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:52:20.574683 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=1 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:52:20.578198 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-4b1ef1ac-6e41-4710-a948-b8353f6f7022 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:52:20.578807 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-4b1ef1ac-6e41-4710-a948-b8353f6f7022 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:52:20.588024 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4b1ef1ac-6e41-4710-a948-b8353f6f7022 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:20.588495 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4b1ef1ac-6e41-4710-a948-b8353f6f7022 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:20.589993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4b1ef1ac-6e41-4710-a948-b8353f6f7022 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:20.589993 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-4b1ef1ac-6e41-4710-a948-b8353f6f7022 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:20.624460 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-4b1ef1ac-6e41-4710-a948-b8353f6f7022 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Going to try to terminate instance {{(pid=124333) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 18:52:20.638106 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-4c3feeed-0e6d-4011-b7e3-fb9b1d574005 req-01d507f9-446f-4508-be66-dbf7a48fa015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48b93fac-2357-4427-b964-61861f4a6eb6", "tag": "10a698cd-e799-4f45-b46b-884f622481bf"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:52:20.650638 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-4c3feeed-0e6d-4011-b7e3-fb9b1d574005 req-01d507f9-446f-4508-be66-dbf7a48fa015 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:20.651019 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-4c3feeed-0e6d-4011-b7e3-fb9b1d574005 req-01d507f9-446f-4508-be66-dbf7a48fa015 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:20.668020 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-4c3feeed-0e6d-4011-b7e3-fb9b1d574005 req-01d507f9-446f-4508-be66-dbf7a48fa015 service nova] Creating event network-changed:10a698cd-e799-4f45-b46b-884f622481bf for instance 48b93fac-2357-4427-b964-61861f4a6eb6 on hv-cinder-84984 Jul 31 18:52:20.674137 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-4c3feeed-0e6d-4011-b7e3-fb9b1d574005 req-01d507f9-446f-4508-be66-dbf7a48fa015 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102758 Jul 31 18:52:20.674875 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 516/1009] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:52:20.720551 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-4b1ef1ac-6e41-4710-a948-b8353f6f7022 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "DELETE /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 204 len: 0 microversion: 2.1 time: 0.151045 Jul 31 18:52:20.721750 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 494/1010] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:52:20 2022] DELETE /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 18:52:20.732782 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-754f482f-e4ea-4585-a282-b7157a4bf742 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:52:20.733996 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-754f482f-e4ea-4585-a282-b7157a4bf742 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:52:20.742321 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-754f482f-e4ea-4585-a282-b7157a4bf742 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:20.742768 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-754f482f-e4ea-4585-a282-b7157a4bf742 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:20.743638 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-754f482f-e4ea-4585-a282-b7157a4bf742 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:20.744078 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-754f482f-e4ea-4585-a282-b7157a4bf742 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:20.886487 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-754f482f-e4ea-4585-a282-b7157a4bf742 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:52:20.894315 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-754f482f-e4ea-4585-a282-b7157a4bf742 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1570 microversion: 2.1 time: 0.167315 Jul 31 18:52:20.894910 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 517/1011] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:52:20 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:52:21.920128 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-d461bb00-46c9-4bf2-bd6b-e0d1e8eeb99f tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:52:21.921309 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-d461bb00-46c9-4bf2-bd6b-e0d1e8eeb99f tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:52:21.931592 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d461bb00-46c9-4bf2-bd6b-e0d1e8eeb99f tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:21.932028 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d461bb00-46c9-4bf2-bd6b-e0d1e8eeb99f tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:21.932788 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d461bb00-46c9-4bf2-bd6b-e0d1e8eeb99f tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:21.933266 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-d461bb00-46c9-4bf2-bd6b-e0d1e8eeb99f tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:22.102513 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-d461bb00-46c9-4bf2-bd6b-e0d1e8eeb99f tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:52:22.110548 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-d461bb00-46c9-4bf2-bd6b-e0d1e8eeb99f tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1570 microversion: 2.1 time: 0.197549 Jul 31 18:52:22.111045 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 495/1012] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:52:21 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1570 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:52:22.886351 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [req-43c4be9d-d895-4e5f-9e38-054aca39885c req-6bd96b54-da62-4e77-8732-1e03d72ec811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b93fac-2357-4427-b964-61861f4a6eb6", "name": "network-vif-deleted", "tag": "10a698cd-e799-4f45-b46b-884f622481bf"}]} {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:52:22.897236 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-43c4be9d-d895-4e5f-9e38-054aca39885c req-6bd96b54-da62-4e77-8732-1e03d72ec811 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:22.897655 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [req-43c4be9d-d895-4e5f-9e38-054aca39885c req-6bd96b54-da62-4e77-8732-1e03d72ec811 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:22.909431 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.compute.server_external_events [req-43c4be9d-d895-4e5f-9e38-054aca39885c req-6bd96b54-da62-4e77-8732-1e03d72ec811 service nova] Creating event network-vif-deleted:10a698cd-e799-4f45-b46b-884f622481bf for instance 48b93fac-2357-4427-b964-61861f4a6eb6 on hv-cinder-84984 Jul 31 18:52:22.914881 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [req-43c4be9d-d895-4e5f-9e38-054aca39885c req-6bd96b54-da62-4e77-8732-1e03d72ec811 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032351 Jul 31 18:52:22.915605 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 518/1013] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:52:23.134841 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-56367c91-2bb1-49eb-949c-7bb836b2ac03 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:52:23.135413 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-56367c91-2bb1-49eb-949c-7bb836b2ac03 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:52:23.141707 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-56367c91-2bb1-49eb-949c-7bb836b2ac03 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:23.142413 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-56367c91-2bb1-49eb-949c-7bb836b2ac03 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:23.143206 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-56367c91-2bb1-49eb-949c-7bb836b2ac03 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:23.143702 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-56367c91-2bb1-49eb-949c-7bb836b2ac03 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:23.225264 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-56367c91-2bb1-49eb-949c-7bb836b2ac03 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1159df549a4b43a9958f389801be2272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bef4721a1fe41d8a8ec8013079a9a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:52:23.234442 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-56367c91-2bb1-49eb-949c-7bb836b2ac03 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 200 len: 1220 microversion: 2.1 time: 0.105236 Jul 31 18:52:23.235034 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 496/1014] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:52:23 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 1220 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:52:24.257757 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-d0343c3f-a659-4783-b23a-685fdd7b5356 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:52:24.258478 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-d0343c3f-a659-4783-b23a-685fdd7b5356 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] [instance: 48b93fac-2357-4427-b964-61861f4a6eb6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:52:24.265373 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d0343c3f-a659-4783-b23a-685fdd7b5356 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:24.265810 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d0343c3f-a659-4783-b23a-685fdd7b5356 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:24.266564 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d0343c3f-a659-4783-b23a-685fdd7b5356 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:24.266988 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-d0343c3f-a659-4783-b23a-685fdd7b5356 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:24.280643 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-d0343c3f-a659-4783-b23a-685fdd7b5356 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] HTTP exception thrown: Instance 48b93fac-2357-4427-b964-61861f4a6eb6 could not be found. Jul 31 18:52:24.282302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-d0343c3f-a659-4783-b23a-685fdd7b5356 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Request method failure captured: Jul 31 18:52:24.282302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 HTTP/1.1 Jul 31 18:52:24.282302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:52:24.282302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:52:24.282302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:52:24.282302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 0 Jul 31 18:52:24.282302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:52:24.282302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:52:24.282302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:52:24.282302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:52:24.282302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5s5j3BBRmuflhaZ98DRuBGpvrqmeLUG8tag-qthwUcvhpSzVNEtc_V_5zPvw25cCKtO3JHBWRRD_XhPpSqsqfVbyKyyXti1PtOFVQk4WE20SSao21QJx_0FHHNW1F0vP7MyELXd3AaJ5J4wk0UaMPOwYzbUo_zeAdedORMCZQZDoMNw Jul 31 18:52:24.282302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:52:24.282302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:52:24.282302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:52:24.282302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:52:24.282302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:52:24.282302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:52:24.282302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: 0bef4721a1fe41d8a8ec8013079a9a93 Jul 31 18:52:24.282302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-TestShelveInstance-891088070 Jul 31 18:52:24.282302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:52:24.282302 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:52:24.283941 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0bef4721a1fe41d8a8ec8013079a9a93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0bef4721a1fe41d8a8ec8013079a9a93", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0bef4721a1fe41d8a8ec8013079a9a93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0bef4721a1fe41d8a8ec8013079a9a93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:52:24.283941 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-TestShelveInstance-891088070 Jul 31 18:52:24.283941 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: 0bef4721a1fe41d8a8ec8013079a9a93 Jul 31 18:52:24.283941 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-TestShelveInstance-891088070 Jul 31 18:52:24.283941 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-TestShelveInstance-891088070-project Jul 31 18:52:24.283941 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:52:24.283941 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:52:24.283941 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: 1159df549a4b43a9958f389801be2272 Jul 31 18:52:24.283941 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-TestShelveInstance-891088070-project Jul 31 18:52:24.283941 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: > Jul 31 18:52:24.283941 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Instance 48b93fac-2357-4427-b964-61861f4a6eb6 could not be found. Jul 31 18:52:24.283941 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'id': '48b93fac-2357-4427-b964-61861f4a6eb6'} Jul 31 18:52:24.285018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:52:24.285018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:52:24.285018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:52:24.285018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:52:24.285018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:52:24.285018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:52:24.285018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:52:24.285018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:52:24.285018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:52:24.285018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:52:24.285018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48b93fac-2357-4427-b964-61861f4a6eb6 could not be found. Jul 31 18:52:24.285018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:52:24.285018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:52:24.285018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:52:24.285018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:52:24.285018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:52:24.285018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:52:24.285018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:52:24.285018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:52:24.285018 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:52:24.286605 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:52:24.286605 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:52:24.286605 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:52:24.286605 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:52:24.286605 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:52:24.286605 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:52:24.286605 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:52:24.286605 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48b93fac-2357-4427-b964-61861f4a6eb6 could not be found. Jul 31 18:52:24.286605 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:52:24.286605 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:52:24.286605 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:52:24.286605 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:52:24.286605 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:52:24.286605 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:52:24.286605 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:52:24.286605 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:52:24.286605 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48b93fac-2357-4427-b964-61861f4a6eb6 could not be found. Jul 31 18:52:24.286605 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:52:24.288151 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-d0343c3f-a659-4783-b23a-685fdd7b5356 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Returning 404 to user: Instance 48b93fac-2357-4427-b964-61861f4a6eb6 could not be found. {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:52:24.288151 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-d0343c3f-a659-4783-b23a-685fdd7b5356 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6" status: 404 len: 111 microversion: 2.1 time: 0.030733 Jul 31 18:52:24.288151 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 519/1015] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:52:24 2022] GET /compute/v2.1/servers/48b93fac-2357-4427-b964-61861f4a6eb6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:52:24.445115 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-2b063751-5cb7-4fe8-87ab-99ab45995167 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] Calling method '.version_select at 0x7f8709f8a280>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:52:24.469543 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-2b063751-5cb7-4fe8-87ab-99ab45995167 tempest-TestShelveInstance-891088070 tempest-TestShelveInstance-891088070-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1973180684" status: 202 len: 0 microversion: 2.1 time: 0.028328 Jul 31 18:52:24.470079 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 497/1016] 10.222.0.49 () {58 vars in 1254 bytes} [Sun Jul 31 18:52:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1973180684 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:52:38.131738 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:52:38.132471 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG dbcounter [-] [124333] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:52:38.136548 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-209253cc-8460-4aa2-92f1-c2760e68cc8a req-2f6356ab-5e38-4dbe-9191-fd9d7d00804c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1be8b918-972d-412f-8a42-73eaa0d73ca6", "tag": "7aa51301-5bd7-4136-b570-23814b380e4d"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:52:38.142703 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-3b5ea8ab-a319-4fea-ac44-43487273f8d0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:52:38.143168 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-3b5ea8ab-a319-4fea-ac44-43487273f8d0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:52:38.146414 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_api:SELECT=8 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:52:38.147019 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG dbcounter [-] [124334] Writing DB stats nova_cell1:SELECT=12 {{(pid=124334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 18:52:38.151189 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3b5ea8ab-a319-4fea-ac44-43487273f8d0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:38.151670 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3b5ea8ab-a319-4fea-ac44-43487273f8d0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:38.152431 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3b5ea8ab-a319-4fea-ac44-43487273f8d0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:38.152880 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-3b5ea8ab-a319-4fea-ac44-43487273f8d0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:38.165712 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-209253cc-8460-4aa2-92f1-c2760e68cc8a req-2f6356ab-5e38-4dbe-9191-fd9d7d00804c service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:38.166163 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-209253cc-8460-4aa2-92f1-c2760e68cc8a req-2f6356ab-5e38-4dbe-9191-fd9d7d00804c service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:38.186354 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-209253cc-8460-4aa2-92f1-c2760e68cc8a req-2f6356ab-5e38-4dbe-9191-fd9d7d00804c service nova] Creating event network-changed:7aa51301-5bd7-4136-b570-23814b380e4d for instance 1be8b918-972d-412f-8a42-73eaa0d73ca6 on hv-cinder-84984 Jul 31 18:52:38.191889 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-209253cc-8460-4aa2-92f1-c2760e68cc8a req-2f6356ab-5e38-4dbe-9191-fd9d7d00804c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061352 Jul 31 18:52:38.192749 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 498/1017] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:52:38.200282 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-3b5ea8ab-a319-4fea-ac44-43487273f8d0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] Going to try to terminate instance {{(pid=124334) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 18:52:38.284628 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-3b5ea8ab-a319-4fea-ac44-43487273f8d0 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6" status: 204 len: 0 microversion: 2.1 time: 0.157494 Jul 31 18:52:38.288404 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 520/1018] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:52:38 2022] DELETE /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 18:52:38.295238 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-fa0fb68c-78c2-4ea2-8761-67d1f9f65a80 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:52:38.296355 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-fa0fb68c-78c2-4ea2-8761-67d1f9f65a80 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:52:38.303714 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-fa0fb68c-78c2-4ea2-8761-67d1f9f65a80 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:38.304164 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-fa0fb68c-78c2-4ea2-8761-67d1f9f65a80 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:38.305033 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-fa0fb68c-78c2-4ea2-8761-67d1f9f65a80 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:38.305663 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-fa0fb68c-78c2-4ea2-8761-67d1f9f65a80 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:38.470678 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-fa0fb68c-78c2-4ea2-8761-67d1f9f65a80 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:52:38.478576 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-fa0fb68c-78c2-4ea2-8761-67d1f9f65a80 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6" status: 200 len: 1578 microversion: 2.1 time: 0.188256 Jul 31 18:52:38.479123 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 499/1019] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:52:38 2022] GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6 => generated 1578 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:52:39.501043 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-a58e514f-4ec9-4c5a-9831-30c9a465a36e tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:52:39.501702 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-a58e514f-4ec9-4c5a-9831-30c9a465a36e tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:52:39.508867 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a58e514f-4ec9-4c5a-9831-30c9a465a36e tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:39.509572 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a58e514f-4ec9-4c5a-9831-30c9a465a36e tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:39.510503 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a58e514f-4ec9-4c5a-9831-30c9a465a36e tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:39.511181 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-a58e514f-4ec9-4c5a-9831-30c9a465a36e tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:39.652292 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-a58e514f-4ec9-4c5a-9831-30c9a465a36e tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:52:39.660344 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-a58e514f-4ec9-4c5a-9831-30c9a465a36e tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6" status: 200 len: 1578 microversion: 2.1 time: 0.164010 Jul 31 18:52:39.661163 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 521/1020] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:52:39 2022] GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:52:40.281525 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-fcef34d3-f94a-4da8-ac70-527c40e249c1 req-116db7b3-ff45-4446-b7bb-98649ca7126f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be8b918-972d-412f-8a42-73eaa0d73ca6", "name": "network-vif-deleted", "tag": "7aa51301-5bd7-4136-b570-23814b380e4d"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:52:40.291912 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-fcef34d3-f94a-4da8-ac70-527c40e249c1 req-116db7b3-ff45-4446-b7bb-98649ca7126f service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:40.292356 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-fcef34d3-f94a-4da8-ac70-527c40e249c1 req-116db7b3-ff45-4446-b7bb-98649ca7126f service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:40.303467 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-fcef34d3-f94a-4da8-ac70-527c40e249c1 req-116db7b3-ff45-4446-b7bb-98649ca7126f service nova] Creating event network-vif-deleted:7aa51301-5bd7-4136-b570-23814b380e4d for instance 1be8b918-972d-412f-8a42-73eaa0d73ca6 on hv-cinder-84984 Jul 31 18:52:40.308719 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-fcef34d3-f94a-4da8-ac70-527c40e249c1 req-116db7b3-ff45-4446-b7bb-98649ca7126f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031002 Jul 31 18:52:40.309530 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 500/1021] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:52:40.682229 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-6da23e06-7abb-47fc-afeb-10088ced1e59 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:52:40.682841 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-6da23e06-7abb-47fc-afeb-10088ced1e59 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:52:40.690272 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6da23e06-7abb-47fc-afeb-10088ced1e59 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:40.690722 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6da23e06-7abb-47fc-afeb-10088ced1e59 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:40.691497 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6da23e06-7abb-47fc-afeb-10088ced1e59 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:40.691934 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6da23e06-7abb-47fc-afeb-10088ced1e59 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:40.725892 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6da23e06-7abb-47fc-afeb-10088ced1e59 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:40.726334 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-6da23e06-7abb-47fc-afeb-10088ced1e59 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:40.726779 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.objects.instance [None req-6da23e06-7abb-47fc-afeb-10088ced1e59 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lazy-loading 'fault' on Instance uuid 1be8b918-972d-412f-8a42-73eaa0d73ca6 {{(pid=124334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:52:40.769108 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-6da23e06-7abb-47fc-afeb-10088ced1e59 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:52:40.776784 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-6da23e06-7abb-47fc-afeb-10088ced1e59 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6" status: 200 len: 1231 microversion: 2.1 time: 0.098509 Jul 31 18:52:40.777382 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 522/1022] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:52:40 2022] GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6 => generated 1231 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:52:41.801362 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-8223dd0c-fe37-46a6-9034-88b3d3b42b25 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:52:41.802204 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-8223dd0c-fe37-46a6-9034-88b3d3b42b25 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 1be8b918-972d-412f-8a42-73eaa0d73ca6] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:52:41.810553 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8223dd0c-fe37-46a6-9034-88b3d3b42b25 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:41.811115 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8223dd0c-fe37-46a6-9034-88b3d3b42b25 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:41.812075 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8223dd0c-fe37-46a6-9034-88b3d3b42b25 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:41.812608 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-8223dd0c-fe37-46a6-9034-88b3d3b42b25 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:41.829039 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-8223dd0c-fe37-46a6-9034-88b3d3b42b25 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] HTTP exception thrown: Instance 1be8b918-972d-412f-8a42-73eaa0d73ca6 could not be found. Jul 31 18:52:41.830648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-8223dd0c-fe37-46a6-9034-88b3d3b42b25 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Request method failure captured: Jul 31 18:52:41.830648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6 HTTP/1.1 Jul 31 18:52:41.830648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:52:41.830648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:52:41.830648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:52:41.830648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:52:41.830648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:52:41.830648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:52:41.830648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:52:41.830648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:52:41.830648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5s3bC3k69B3jZmJOmo1KbmUV2obujTk7HT8uZ4b1X76LBJZA6DUZzarRVS2pzVXF4ztEZUJX3Bx63LFGTL34ydJTS4JZpsRP6SAK3NnzyKHxL6_kFfTsp-FCDCeOZGmibRya77SPDY2Wr6U-G0QTv0j2EGAPZqqC64v7MhvsGfDuI8o Jul 31 18:52:41.830648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:52:41.830648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:52:41.830648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:52:41.830648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:52:41.830648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:52:41.830648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:52:41.830648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: 11018257977c4b8ba8f008c0c6ae65fd Jul 31 18:52:41.830648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-TestVolumeBootPattern-1549899629 Jul 31 18:52:41.830648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:52:41.830648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:52:41.832201 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/11018257977c4b8ba8f008c0c6ae65fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_11018257977c4b8ba8f008c0c6ae65fd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/11018257977c4b8ba8f008c0c6ae65fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/11018257977c4b8ba8f008c0c6ae65fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:52:41.832201 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-TestVolumeBootPattern-1549899629 Jul 31 18:52:41.832201 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: 11018257977c4b8ba8f008c0c6ae65fd Jul 31 18:52:41.832201 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-TestVolumeBootPattern-1549899629 Jul 31 18:52:41.832201 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-TestVolumeBootPattern-1549899629-project Jul 31 18:52:41.832201 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:52:41.832201 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:52:41.832201 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 64d0451d06294c968712f411f90f224e Jul 31 18:52:41.832201 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-TestVolumeBootPattern-1549899629-project Jul 31 18:52:41.832201 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: > Jul 31 18:52:41.832201 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Instance 1be8b918-972d-412f-8a42-73eaa0d73ca6 could not be found. Jul 31 18:52:41.832201 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': '1be8b918-972d-412f-8a42-73eaa0d73ca6'} Jul 31 18:52:41.833212 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:52:41.833212 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:52:41.833212 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:52:41.833212 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:52:41.833212 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:52:41.833212 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:52:41.833212 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:52:41.833212 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:52:41.833212 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:52:41.833212 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:52:41.833212 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1be8b918-972d-412f-8a42-73eaa0d73ca6 could not be found. Jul 31 18:52:41.833212 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:52:41.833212 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:52:41.833212 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:52:41.833212 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:52:41.833212 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:52:41.833212 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:52:41.833212 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:52:41.833212 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:52:41.833212 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:52:41.834745 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:52:41.834745 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:52:41.834745 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:52:41.834745 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:52:41.834745 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:52:41.834745 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:52:41.834745 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:52:41.834745 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1be8b918-972d-412f-8a42-73eaa0d73ca6 could not be found. Jul 31 18:52:41.834745 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:52:41.834745 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:52:41.834745 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:52:41.834745 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:52:41.834745 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:52:41.834745 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:52:41.834745 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:52:41.834745 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:52:41.834745 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1be8b918-972d-412f-8a42-73eaa0d73ca6 could not be found. Jul 31 18:52:41.834745 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:52:41.836178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-8223dd0c-fe37-46a6-9034-88b3d3b42b25 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Returning 404 to user: Instance 1be8b918-972d-412f-8a42-73eaa0d73ca6 could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:52:41.836178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-8223dd0c-fe37-46a6-9034-88b3d3b42b25 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6" status: 404 len: 111 microversion: 2.1 time: 0.036816 Jul 31 18:52:41.836178 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 501/1023] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:52:41 2022] GET /compute/v2.1/servers/1be8b918-972d-412f-8a42-73eaa0d73ca6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:52:44.953167 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-8c8e0dd8-0e24-4f94-a09f-7ca15f8f471c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:52:44.953661 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-8c8e0dd8-0e24-4f94-a09f-7ca15f8f471c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:52:44.954942 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-fd5bd884-d3bc-4b05-8398-9624a0fbf639 req-249d4c49-316c-4a4e-9b1e-2b4f8522ce45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03569973-013c-44c3-9a61-c819f4995a0f", "tag": "19fab060-72a0-4b39-869a-3b38d61a6ffd"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:52:44.961291 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8c8e0dd8-0e24-4f94-a09f-7ca15f8f471c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:44.961858 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8c8e0dd8-0e24-4f94-a09f-7ca15f8f471c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:44.962859 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8c8e0dd8-0e24-4f94-a09f-7ca15f8f471c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:44.963368 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-8c8e0dd8-0e24-4f94-a09f-7ca15f8f471c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:44.965729 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-fd5bd884-d3bc-4b05-8398-9624a0fbf639 req-249d4c49-316c-4a4e-9b1e-2b4f8522ce45 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:44.966169 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-fd5bd884-d3bc-4b05-8398-9624a0fbf639 req-249d4c49-316c-4a4e-9b1e-2b4f8522ce45 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:44.977768 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-fd5bd884-d3bc-4b05-8398-9624a0fbf639 req-249d4c49-316c-4a4e-9b1e-2b4f8522ce45 service nova] Creating event network-changed:19fab060-72a0-4b39-869a-3b38d61a6ffd for instance 03569973-013c-44c3-9a61-c819f4995a0f on hv-cinder-84984 Jul 31 18:52:44.983708 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-fd5bd884-d3bc-4b05-8398-9624a0fbf639 req-249d4c49-316c-4a4e-9b1e-2b4f8522ce45 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032375 Jul 31 18:52:44.984896 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 502/1024] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:52:44.990150 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-8c8e0dd8-0e24-4f94-a09f-7ca15f8f471c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] Going to try to terminate instance {{(pid=124334) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 18:52:45.072688 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-8c8e0dd8-0e24-4f94-a09f-7ca15f8f471c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "DELETE /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f" status: 204 len: 0 microversion: 2.1 time: 0.123223 Jul 31 18:52:45.073569 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 523/1025] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:52:44 2022] DELETE /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 18:52:45.084082 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-b0ef7443-7a6b-485f-b722-0a0c98526d69 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:52:45.085085 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-b0ef7443-7a6b-485f-b722-0a0c98526d69 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:52:45.091931 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b0ef7443-7a6b-485f-b722-0a0c98526d69 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:45.092791 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b0ef7443-7a6b-485f-b722-0a0c98526d69 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:45.093832 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b0ef7443-7a6b-485f-b722-0a0c98526d69 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:45.094658 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b0ef7443-7a6b-485f-b722-0a0c98526d69 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:45.414406 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.policy [None req-b0ef7443-7a6b-485f-b722-0a0c98526d69 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124333) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:52:45.422301 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-b0ef7443-7a6b-485f-b722-0a0c98526d69 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f" status: 200 len: 1578 microversion: 2.1 time: 0.342840 Jul 31 18:52:45.422955 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 503/1026] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:52:45 2022] GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f => generated 1578 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:52:46.444787 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-2262c550-bd75-4e1f-937a-b79fdc7956b6 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:52:46.445491 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-2262c550-bd75-4e1f-937a-b79fdc7956b6 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:52:46.452232 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2262c550-bd75-4e1f-937a-b79fdc7956b6 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:46.452614 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2262c550-bd75-4e1f-937a-b79fdc7956b6 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:46.453402 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2262c550-bd75-4e1f-937a-b79fdc7956b6 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:46.453839 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-2262c550-bd75-4e1f-937a-b79fdc7956b6 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:46.652023 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-2262c550-bd75-4e1f-937a-b79fdc7956b6 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:52:46.659938 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-2262c550-bd75-4e1f-937a-b79fdc7956b6 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f" status: 200 len: 1578 microversion: 2.1 time: 0.219726 Jul 31 18:52:46.661410 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 524/1027] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:52:46 2022] GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f => generated 1578 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:52:47.187515 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [req-7c23b927-6bfd-4006-a83d-49a85d61639a req-2be357d0-0d56-4747-8603-7fe9b1eff554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03569973-013c-44c3-9a61-c819f4995a0f", "name": "network-vif-deleted", "tag": "19fab060-72a0-4b39-869a-3b38d61a6ffd"}]} {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 18:52:47.199998 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-7c23b927-6bfd-4006-a83d-49a85d61639a req-2be357d0-0d56-4747-8603-7fe9b1eff554 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:47.200449 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [req-7c23b927-6bfd-4006-a83d-49a85d61639a req-2be357d0-0d56-4747-8603-7fe9b1eff554 service nova] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:47.212319 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.compute.server_external_events [req-7c23b927-6bfd-4006-a83d-49a85d61639a req-2be357d0-0d56-4747-8603-7fe9b1eff554 service nova] Creating event network-vif-deleted:19fab060-72a0-4b39-869a-3b38d61a6ffd for instance 03569973-013c-44c3-9a61-c819f4995a0f on hv-cinder-84984 Jul 31 18:52:47.218090 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [req-7c23b927-6bfd-4006-a83d-49a85d61639a req-2be357d0-0d56-4747-8603-7fe9b1eff554 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034535 Jul 31 18:52:47.219106 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 504/1028] 10.222.0.49 () {64 vars in 1317 bytes} [Sun Jul 31 18:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 18:52:47.683463 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-be7c6d48-8798-498a-9666-09cd3d00ff2c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:52:47.684074 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-be7c6d48-8798-498a-9666-09cd3d00ff2c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:52:47.691552 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-be7c6d48-8798-498a-9666-09cd3d00ff2c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:47.691998 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-be7c6d48-8798-498a-9666-09cd3d00ff2c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:47.692942 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-be7c6d48-8798-498a-9666-09cd3d00ff2c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:47.693373 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-be7c6d48-8798-498a-9666-09cd3d00ff2c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:47.730953 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-be7c6d48-8798-498a-9666-09cd3d00ff2c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:47.731395 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-be7c6d48-8798-498a-9666-09cd3d00ff2c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:47.731834 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.objects.instance [None req-be7c6d48-8798-498a-9666-09cd3d00ff2c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lazy-loading 'fault' on Instance uuid 03569973-013c-44c3-9a61-c819f4995a0f {{(pid=124334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 18:52:47.773790 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.policy [None req-be7c6d48-8798-498a-9666-09cd3d00ff2c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d0451d06294c968712f411f90f224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11018257977c4b8ba8f008c0c6ae65fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124334) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 18:52:47.781638 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-be7c6d48-8798-498a-9666-09cd3d00ff2c tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f" status: 200 len: 1231 microversion: 2.1 time: 0.102089 Jul 31 18:52:47.782185 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 525/1029] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:52:47 2022] GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f => generated 1231 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 18:52:48.807885 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-5d544c22-2c35-4e4f-a8a5-15e1d6d1595b tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:52:48.809069 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-5d544c22-2c35-4e4f-a8a5-15e1d6d1595b tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: 03569973-013c-44c3-9a61-c819f4995a0f] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:52:48.820910 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5d544c22-2c35-4e4f-a8a5-15e1d6d1595b tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:48.821653 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5d544c22-2c35-4e4f-a8a5-15e1d6d1595b tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:48.822915 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5d544c22-2c35-4e4f-a8a5-15e1d6d1595b tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:48.823637 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-5d544c22-2c35-4e4f-a8a5-15e1d6d1595b tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:48.839467 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-5d544c22-2c35-4e4f-a8a5-15e1d6d1595b tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] HTTP exception thrown: Instance 03569973-013c-44c3-9a61-c819f4995a0f could not be found. Jul 31 18:52:48.841155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-5d544c22-2c35-4e4f-a8a5-15e1d6d1595b tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Request method failure captured: Jul 31 18:52:48.841155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f HTTP/1.1 Jul 31 18:52:48.841155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:52:48.841155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:52:48.841155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:52:48.841155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:52:48.841155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:52:48.841155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:52:48.841155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:52:48.841155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:52:48.841155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5s3bC3k69B3jZmJOmo1KbmUV2obujTk7HT8uZ4b1X76LBJZA6DUZzarRVS2pzVXF4ztEZUJX3Bx63LFGTL34ydJTS4JZpsRP6SAK3NnzyKHxL6_kFfTsp-FCDCeOZGmibRya77SPDY2Wr6U-G0QTv0j2EGAPZqqC64v7MhvsGfDuI8o Jul 31 18:52:48.841155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:52:48.841155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:52:48.841155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:52:48.841155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:52:48.841155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:52:48.841155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:52:48.841155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: 11018257977c4b8ba8f008c0c6ae65fd Jul 31 18:52:48.841155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-TestVolumeBootPattern-1549899629 Jul 31 18:52:48.841155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:52:48.841155 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:52:48.842715 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/11018257977c4b8ba8f008c0c6ae65fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_11018257977c4b8ba8f008c0c6ae65fd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/11018257977c4b8ba8f008c0c6ae65fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/11018257977c4b8ba8f008c0c6ae65fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:52:48.842715 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-TestVolumeBootPattern-1549899629 Jul 31 18:52:48.842715 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: 11018257977c4b8ba8f008c0c6ae65fd Jul 31 18:52:48.842715 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-TestVolumeBootPattern-1549899629 Jul 31 18:52:48.842715 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-TestVolumeBootPattern-1549899629-project Jul 31 18:52:48.842715 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:52:48.842715 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:52:48.842715 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 64d0451d06294c968712f411f90f224e Jul 31 18:52:48.842715 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-TestVolumeBootPattern-1549899629-project Jul 31 18:52:48.842715 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: > Jul 31 18:52:48.842715 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Instance 03569973-013c-44c3-9a61-c819f4995a0f could not be found. Jul 31 18:52:48.842715 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': '03569973-013c-44c3-9a61-c819f4995a0f'} Jul 31 18:52:48.843638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:52:48.843638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:52:48.843638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:52:48.843638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:52:48.843638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:52:48.843638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:52:48.843638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:52:48.843638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:52:48.843638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:52:48.843638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:52:48.843638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03569973-013c-44c3-9a61-c819f4995a0f could not be found. Jul 31 18:52:48.843638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:52:48.843638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:52:48.843638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:52:48.843638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:52:48.843638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:52:48.843638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:52:48.843638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:52:48.843638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:52:48.843638 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:52:48.845128 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:52:48.845128 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:52:48.845128 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:52:48.845128 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:52:48.845128 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:52:48.845128 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:52:48.845128 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:52:48.845128 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03569973-013c-44c3-9a61-c819f4995a0f could not be found. Jul 31 18:52:48.845128 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:52:48.845128 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:52:48.845128 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:52:48.845128 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:52:48.845128 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:52:48.845128 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:52:48.845128 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:52:48.845128 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:52:48.845128 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03569973-013c-44c3-9a61-c819f4995a0f could not be found. Jul 31 18:52:48.845128 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:52:48.846562 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-5d544c22-2c35-4e4f-a8a5-15e1d6d1595b tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Returning 404 to user: Instance 03569973-013c-44c3-9a61-c819f4995a0f could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:52:48.846562 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-5d544c22-2c35-4e4f-a8a5-15e1d6d1595b tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f" status: 404 len: 111 microversion: 2.1 time: 0.041635 Jul 31 18:52:48.846562 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 505/1030] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:52:48 2022] GET /compute/v2.1/servers/03569973-013c-44c3-9a61-c819f4995a0f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:52:49.294031 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f030e070-c66d-4191-b381-d0fb2e0818cf tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:52:49.294564 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.compute.api [None req-f030e070-c66d-4191-b381-d0fb2e0818cf tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: b660fdbd-8dc6-4ed3-81b3-73121c89761a] Fetching instance by UUID {{(pid=124334) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:52:49.301591 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f030e070-c66d-4191-b381-d0fb2e0818cf tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:49.302032 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f030e070-c66d-4191-b381-d0fb2e0818cf tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:49.302803 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f030e070-c66d-4191-b381-d0fb2e0818cf tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:49.303236 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG oslo_concurrency.lockutils [None req-f030e070-c66d-4191-b381-d0fb2e0818cf tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:49.316691 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.wsgi [None req-f030e070-c66d-4191-b381-d0fb2e0818cf tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] HTTP exception thrown: Instance b660fdbd-8dc6-4ed3-81b3-73121c89761a could not be found. Jul 31 18:52:49.318352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f030e070-c66d-4191-b381-d0fb2e0818cf tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Request method failure captured: Jul 31 18:52:49.318352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: request: DELETE /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a HTTP/1.1 Jul 31 18:52:49.318352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept: application/json Jul 31 18:52:49.318352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Accept-Encoding: identity Jul 31 18:52:49.318352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Connection: close Jul 31 18:52:49.318352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Length: 0 Jul 31 18:52:49.318352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Content-Type: application/json Jul 31 18:52:49.318352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Host: 10.222.0.49 Jul 31 18:52:49.318352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Openstack-System-Scope: None Jul 31 18:52:49.318352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: User-Agent: python-urllib3/1.26.10 Jul 31 18:52:49.318352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Auth-Token: gAAAAABi5s3bC3k69B3jZmJOmo1KbmUV2obujTk7HT8uZ4b1X76LBJZA6DUZzarRVS2pzVXF4ztEZUJX3Bx63LFGTL34ydJTS4JZpsRP6SAK3NnzyKHxL6_kFfTsp-FCDCeOZGmibRya77SPDY2Wr6U-G0QTv0j2EGAPZqqC64v7MhvsGfDuI8o Jul 31 18:52:49.318352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Id: None Jul 31 18:52:49.318352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Domain-Name: None Jul 31 18:52:49.318352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Identity-Status: Confirmed Jul 31 18:52:49.318352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Is-Admin-Project: True Jul 31 18:52:49.318352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Id: default Jul 31 18:52:49.318352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Domain-Name: Default Jul 31 18:52:49.318352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Id: 11018257977c4b8ba8f008c0c6ae65fd Jul 31 18:52:49.318352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Project-Name: tempest-TestVolumeBootPattern-1549899629 Jul 31 18:52:49.318352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Role: member,reader Jul 31 18:52:49.318352 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Roles: member,reader Jul 31 18:52:49.319856 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/11018257977c4b8ba8f008c0c6ae65fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_11018257977c4b8ba8f008c0c6ae65fd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/11018257977c4b8ba8f008c0c6ae65fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/11018257977c4b8ba8f008c0c6ae65fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:52:49.319856 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant: tempest-TestVolumeBootPattern-1549899629 Jul 31 18:52:49.319856 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Id: 11018257977c4b8ba8f008c0c6ae65fd Jul 31 18:52:49.319856 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-Tenant-Name: tempest-TestVolumeBootPattern-1549899629 Jul 31 18:52:49.319856 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User: tempest-TestVolumeBootPattern-1549899629-project Jul 31 18:52:49.319856 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Id: default Jul 31 18:52:49.319856 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Domain-Name: Default Jul 31 18:52:49.319856 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Id: 64d0451d06294c968712f411f90f224e Jul 31 18:52:49.319856 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: X-User-Name: tempest-TestVolumeBootPattern-1549899629-project Jul 31 18:52:49.319856 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: method: > Jul 31 18:52:49.319856 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: exception: Instance b660fdbd-8dc6-4ed3-81b3-73121c89761a could not be found. Jul 31 18:52:49.319856 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: action_args: {'id': 'b660fdbd-8dc6-4ed3-81b3-73121c89761a'} Jul 31 18:52:49.320620 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:52:49.320620 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:52:49.320620 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:52:49.320620 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:52:49.320620 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:52:49.320620 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:52:49.320620 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:52:49.320620 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:52:49.320620 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:52:49.320620 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:52:49.320620 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b660fdbd-8dc6-4ed3-81b3-73121c89761a could not be found. Jul 31 18:52:49.320620 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:52:49.320620 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:52:49.320620 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:52:49.320620 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:52:49.320620 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:52:49.320620 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:52:49.320620 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:52:49.320620 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:52:49.320620 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:52:49.321892 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:52:49.321892 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 18:52:49.321892 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 18:52:49.321892 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 18:52:49.321892 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 18:52:49.321892 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:52:49.321892 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:52:49.321892 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:52:49.321892 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:52:49.321892 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b660fdbd-8dc6-4ed3-81b3-73121c89761a could not be found. Jul 31 18:52:49.321892 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:52:49.321892 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:52:49.321892 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:52:49.321892 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:52:49.321892 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:52:49.321892 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:52:49.321892 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:52:49.321892 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:52:49.321892 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b660fdbd-8dc6-4ed3-81b3-73121c89761a could not be found. Jul 31 18:52:49.321892 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: ERROR nova.api.openstack.wsgi Jul 31 18:52:49.323157 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-f030e070-c66d-4191-b381-d0fb2e0818cf tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Returning 404 to user: Instance b660fdbd-8dc6-4ed3-81b3-73121c89761a could not be found. {{(pid=124334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:52:49.323157 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-f030e070-c66d-4191-b381-d0fb2e0818cf tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a" status: 404 len: 111 microversion: 2.1 time: 0.029743 Jul 31 18:52:49.323157 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 526/1031] 10.222.0.49 () {58 vars in 1239 bytes} [Sun Jul 31 18:52:49 2022] DELETE /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:52:49.328679 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-b23160af-ab18-47e8-aea7-4aba97ac878f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '>' {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:52:49.329319 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.compute.api [None req-b23160af-ab18-47e8-aea7-4aba97ac878f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] [instance: b660fdbd-8dc6-4ed3-81b3-73121c89761a] Fetching instance by UUID {{(pid=124333) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 18:52:49.335618 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b23160af-ab18-47e8-aea7-4aba97ac878f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:49.336060 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b23160af-ab18-47e8-aea7-4aba97ac878f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:49.336879 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b23160af-ab18-47e8-aea7-4aba97ac878f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 18:52:49.337474 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG oslo_concurrency.lockutils [None req-b23160af-ab18-47e8-aea7-4aba97ac878f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Lock "2ecbfed3-af85-4afe-b379-031f6ba6062f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 18:52:49.356648 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.wsgi [None req-b23160af-ab18-47e8-aea7-4aba97ac878f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] HTTP exception thrown: Instance b660fdbd-8dc6-4ed3-81b3-73121c89761a could not be found. Jul 31 18:52:49.359247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-b23160af-ab18-47e8-aea7-4aba97ac878f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Request method failure captured: Jul 31 18:52:49.359247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: request: GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a HTTP/1.1 Jul 31 18:52:49.359247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept: application/json Jul 31 18:52:49.359247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Accept-Encoding: identity Jul 31 18:52:49.359247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Connection: close Jul 31 18:52:49.359247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Length: 0 Jul 31 18:52:49.359247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Content-Type: application/json Jul 31 18:52:49.359247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Host: 10.222.0.49 Jul 31 18:52:49.359247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Openstack-System-Scope: None Jul 31 18:52:49.359247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: User-Agent: python-urllib3/1.26.10 Jul 31 18:52:49.359247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Auth-Token: gAAAAABi5s3bC3k69B3jZmJOmo1KbmUV2obujTk7HT8uZ4b1X76LBJZA6DUZzarRVS2pzVXF4ztEZUJX3Bx63LFGTL34ydJTS4JZpsRP6SAK3NnzyKHxL6_kFfTsp-FCDCeOZGmibRya77SPDY2Wr6U-G0QTv0j2EGAPZqqC64v7MhvsGfDuI8o Jul 31 18:52:49.359247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Id: None Jul 31 18:52:49.359247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Domain-Name: None Jul 31 18:52:49.359247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Identity-Status: Confirmed Jul 31 18:52:49.359247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Is-Admin-Project: True Jul 31 18:52:49.359247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Id: default Jul 31 18:52:49.359247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Domain-Name: Default Jul 31 18:52:49.359247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Id: 11018257977c4b8ba8f008c0c6ae65fd Jul 31 18:52:49.359247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Project-Name: tempest-TestVolumeBootPattern-1549899629 Jul 31 18:52:49.359247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Role: member,reader Jul 31 18:52:49.359247 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Roles: member,reader Jul 31 18:52:49.361090 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/11018257977c4b8ba8f008c0c6ae65fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_11018257977c4b8ba8f008c0c6ae65fd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/11018257977c4b8ba8f008c0c6ae65fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/11018257977c4b8ba8f008c0c6ae65fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Jul 31 18:52:49.361090 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant: tempest-TestVolumeBootPattern-1549899629 Jul 31 18:52:49.361090 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Id: 11018257977c4b8ba8f008c0c6ae65fd Jul 31 18:52:49.361090 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-Tenant-Name: tempest-TestVolumeBootPattern-1549899629 Jul 31 18:52:49.361090 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User: tempest-TestVolumeBootPattern-1549899629-project Jul 31 18:52:49.361090 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Id: default Jul 31 18:52:49.361090 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Domain-Name: Default Jul 31 18:52:49.361090 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Id: 64d0451d06294c968712f411f90f224e Jul 31 18:52:49.361090 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: X-User-Name: tempest-TestVolumeBootPattern-1549899629-project Jul 31 18:52:49.361090 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: method: > Jul 31 18:52:49.361090 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: exception: Instance b660fdbd-8dc6-4ed3-81b3-73121c89761a could not be found. Jul 31 18:52:49.361090 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: action_args: {'id': 'b660fdbd-8dc6-4ed3-81b3-73121c89761a'} Jul 31 18:52:49.362035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: {{(pid=124333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 18:52:49.362035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:52:49.362035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 18:52:49.362035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 18:52:49.362035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 18:52:49.362035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 18:52:49.362035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 18:52:49.362035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 18:52:49.362035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 18:52:49.362035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 18:52:49.362035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b660fdbd-8dc6-4ed3-81b3-73121c89761a could not be found. Jul 31 18:52:49.362035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:52:49.362035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:52:49.362035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:52:49.362035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:52:49.362035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:52:49.362035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:52:49.362035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 18:52:49.362035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 18:52:49.362035 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 18:52:49.364122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 18:52:49.364122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 18:52:49.364122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 18:52:49.364122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 18:52:49.364122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 18:52:49.364122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 18:52:49.364122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 18:52:49.364122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b660fdbd-8dc6-4ed3-81b3-73121c89761a could not be found. Jul 31 18:52:49.364122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:52:49.364122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 18:52:49.364122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:52:49.364122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 18:52:49.364122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 18:52:49.364122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 18:52:49.364122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 18:52:49.364122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 18:52:49.364122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b660fdbd-8dc6-4ed3-81b3-73121c89761a could not be found. Jul 31 18:52:49.364122 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: ERROR nova.api.openstack.wsgi Jul 31 18:52:49.366313 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: DEBUG nova.api.openstack.wsgi [None req-b23160af-ab18-47e8-aea7-4aba97ac878f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Returning 404 to user: Instance b660fdbd-8dc6-4ed3-81b3-73121c89761a could not be found. {{(pid=124333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 18:52:49.366313 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO nova.api.openstack.requestlog [None req-b23160af-ab18-47e8-aea7-4aba97ac878f tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a" status: 404 len: 111 microversion: 2.1 time: 0.036209 Jul 31 18:52:49.366313 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: [pid: 124333|app: 0|req: 506/1032] 10.222.0.49 () {58 vars in 1236 bytes} [Sun Jul 31 18:52:49 2022] GET /compute/v2.1/servers/b660fdbd-8dc6-4ed3-81b3-73121c89761a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 18:52:50.681372 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: DEBUG nova.api.openstack.wsgi [None req-45acb1f3-d338-407d-b54d-c5d0c7950d08 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] Calling method '.version_select at 0x7f87099498b0>' {{(pid=124334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 18:52:50.707448 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO nova.api.openstack.requestlog [None req-45acb1f3-d338-407d-b54d-c5d0c7950d08 tempest-TestVolumeBootPattern-1549899629 tempest-TestVolumeBootPattern-1549899629-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1726321377" status: 202 len: 0 microversion: 2.1 time: 0.030393 Jul 31 18:52:50.708046 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: [pid: 124334|app: 0|req: 527/1033] 10.222.0.49 () {58 vars in 1263 bytes} [Sun Jul 31 18:52:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1726321377 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 18:54:02.837892 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 18:54:02.838886 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Sun Jul 31 18:54:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 18:55:44.363799 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 18:55:44.365018 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Sun Jul 31 18:55:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 18:55:48.001640 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 18:55:48.002461 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Sun Jul 31 18:55:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 18:55:55.662930 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 18:55:55.664223 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Sun Jul 31 18:55:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 18:55:58.307624 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 18:55:58.308662 dv-cinder-849846-5-iscsi devstack@n-api.service[124334]: Sun Jul 31 18:55:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 18:57:22.851230 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 18:57:22.852195 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Sun Jul 31 18:57:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 18:57:48.797529 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 18:57:48.798630 dv-cinder-849846-5-iscsi devstack@n-api.service[124333]: Sun Jul 31 18:57:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!